Apache Spark Module Lead
__jobinformationwidget.freetext.LocationText__
Chennai, Tamil Nadu, India
- Sopra Steria
- Engineering, Development, Applications
- 3 to 5 years
- Standard
- India
About Sopra Steria
Sopra Steria, a major Tech player in Europe with 56,000 employees in nearly 30 countries, is recognized for its consulting, digital services and software development. It helps its clients drive their digital transformation and obtain tangible and sustainable benefits. The Group provides end-to-end solutions to make large companies and organizations more competitive by combining in-depth knowledge of a wide range of business sectors and innovative technologies with a fully collaborative approach. Sopra Steria places people at the heart of everything it does and is committed to putting digital to work for its clients in order to build a positive future for all. In 2023, the Group generated revenues of €5.8 billion.
The world is how we shape it.
Data Engineer with Big Data development experience - (4-5 yrs. experience)
Required Skills:
- Strong expertise of programming languages – Python/Scala/others
- Hands-on experience in Spark with Scala and Python(PySpark) including Data frame core functions, SparkSQL, Spark Streaming and with HIVE, Hadoop, Kafka, YARN.
- Good Experience in Big data cloud platform, preferably Azure.
- Databricks and coding with notebooks.
- Hands-on experience with data orchestration tools such as Airflow, Apache NiFi
- Processing and manipulating data using SQL and Python code.
- Professional experience implementing data ingestion pipelines using Data Factory.
- Building and optimizing data pipelines, architectures, and data sets.
- Working knowledge of queueing, stream processing, and highly scalable data stores
- User training, customer support, and coordination with cross-functional teams.
- Writing database-heavy services or APIs.
- Strong understanding of structuring code for testability.
- Should be able to perform estimations, lead the team technically, Monitoring & Tracking of activities.
- Should be able to coordinate and communicate well with customer.
Good to have:
- Professional Data Engineer Certifications in Data Bricks.
- Familiarity with GIT workflow, CI/CD Pipelines.
- Working Knowledge of Azure DevOps environment.
- Experience of Agile practices & methodologies.
- Experience on Migration projects (Scala/PySpark).
- Flexibility to work in both support and development projects
Total Experience Expected: 04-06 years
- Education: B.E./ B.Tech./ MCA
At our organization, we are committed to fighting against all forms of discrimination. We foster a work environment that is inclusive and respectful of all differences.
All of our positions are open to people with disabilities.
Discover what working at Sopra Steria looks like...
Are you looking for a place where you can free your creativity and take initiatives, supported by tech experts?
Join us on this adventure where every idea counts and every talent steps up.
Job offers that might interest you
Salary
Location
Bengaluru, Karnataka, India
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Bengaluru, Karnataka
Description
Embedded Testing CMC - Experience 5 to 10 years Mandatory Skills:Expertise in EMBEDDED C++ Experience in Embedded CExperience in V&V as per DO178B/C guidelines Experience in DO330, tool qualificationE
Reference
98e54ce8-c799-4631-8ee6-50522999c49e
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Noida, Uttar Pradesh, India
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Noida, Uttar Pradesh
Description
Core ABAP • Highly skilled professional with 4-6 years of proven track record in significant • ADOBE forms,Form Printing (Smart Forms & Script), Web-dynpro, LSMW, ABAP Objects, ALV Interactive/OOPS, E
Reference
a10ddb0e-a8e4-419d-b99f-6897106371b8
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Noida, Uttar Pradesh, India
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Noida, Uttar Pradesh
Description
In-depth knowledge of .NET infrastructure.Advanced proficiency in C#, F#, or VB.NET; preferably all three.Capacity to use SQL or Oracle with ease.A flair for creating well-presented software that is t
Reference
f8104721-953b-428c-9433-0ea15331e67e
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Noida, Uttar Pradesh, India
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Noida, Uttar Pradesh
Description
Roles and Responsibilities:Administration of MFT Axway solutions including Secure Transport, XFB Gateway, CFT, and Sentinel.Configuration and maintenance of secure data communication protocols: SFTP,
Reference
1c838cd0-02cb-40ad-a1ac-c6353c0b4490
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Bengaluru, Karnataka, India
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Bengaluru, Karnataka
Description
Frontend - AngularBackend - Java Database - SQL Excellent grip on programming with Java and AngularStrong understanding of Java FrameworksWriting unit test cases for the backend codeWriting clean, opt
Reference
15557b6c-d435-4028-b738-3d898d67e39e
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Bengaluru, Karnataka, India
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Bengaluru, Karnataka
Description
Must to have skills○ C# ○ .Net○ JavaScript ○ SQL server○ XML○ Git Source code Management○ Agile Tools-JIRA/VersionOne/confluence Good to have skills○ PLM domain knowledge ○ Understanding of CI/CD pipe
Reference
d3a1da23-140f-482b-9b0a-15ea9d688d39
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Bengaluru, Karnataka, India
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Bengaluru, Karnataka
Description
Primary skills :Good programming skills on Python using Django frameworkAngular > 13.1 is a mustGood knowledge on JavaScript is a mustPostGres database knowledge is a must Mandatory Skills :Frontend -
Reference
fe206438-6d49-47bd-bf0d-8e4e7357a15d
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Bengaluru, Karnataka, India
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Bengaluru, Karnataka
Description
Detailed JD:Engineering graduate with 6+ years of functional experience in Airbus PLM applications.Functional Knowledge on PASS-Product Data Management (with understanding of Product Structure, Releas
Reference
18bc6ca6-a5ac-422d-8528-f15a4302c702
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Bengaluru, Karnataka, India
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Bengaluru, Karnataka
Description
Must to have skills○ 4 years of experience in .NET framework/Core implementation projects ○ Experience in .Net(v4) & C#○ Experience in RESTful API backend in .Net (Entity Framework) ○ Experience with
Reference
bb832b1d-9f9d-423c-bd56-657a0e71f10d
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Noida, Uttar Pradesh, India
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Noida, Uttar Pradesh
Description
Experience and Skills Required-Experience on different EDI Integration plate forms like IBM Sterling Integrator, Axway B2bi, Open Text, Seeburger etc.Strong Mapping Experience using various formats li
Reference
b8d58025-0789-491c-a78e-2fe29b74d0d0
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah Smith