Apache Spark Module Lead
__jobinformationwidget.freetext.LocationText__
Chennai, Tamil Nadu, India
- Sopra Steria
- Engineering, Development, Applications
- 3 to 5 years
- Standard
- India
This vacancy has now expired. Please see similar roles below...
About Sopra Steria
Sopra Steria, a major Tech player in Europe with 56,000 employees in nearly 30 countries, is recognized for its consulting, digital services and software development. It helps its clients drive their digital transformation and obtain tangible and sustainable benefits. The Group provides end-to-end solutions to make large companies and organizations more competitive by combining in-depth knowledge of a wide range of business sectors and innovative technologies with a fully collaborative approach. Sopra Steria places people at the heart of everything it does and is committed to putting digital to work for its clients in order to build a positive future for all. In 2023, the Group generated revenues of €5.8 billion.
The world is how we shape it.
Data Engineer with Big Data development experience - (4-5 yrs. experience)
Required Skills:
- Strong expertise of programming languages – Python/Scala/others
- Hands-on experience in Spark with Scala and Python(PySpark) including Data frame core functions, SparkSQL, Spark Streaming and with HIVE, Hadoop, Kafka, YARN.
- Good Experience in Big data cloud platform, preferably Azure.
- Databricks and coding with notebooks.
- Hands-on experience with data orchestration tools such as Airflow, Apache NiFi
- Processing and manipulating data using SQL and Python code.
- Professional experience implementing data ingestion pipelines using Data Factory.
- Building and optimizing data pipelines, architectures, and data sets.
- Working knowledge of queueing, stream processing, and highly scalable data stores
- User training, customer support, and coordination with cross-functional teams.
- Writing database-heavy services or APIs.
- Strong understanding of structuring code for testability.
- Should be able to perform estimations, lead the team technically, Monitoring & Tracking of activities.
- Should be able to coordinate and communicate well with customer.
Good to have:
- Professional Data Engineer Certifications in Data Bricks.
- Familiarity with GIT workflow, CI/CD Pipelines.
- Working Knowledge of Azure DevOps environment.
- Experience of Agile practices & methodologies.
- Experience on Migration projects (Scala/PySpark).
- Flexibility to work in both support and development projects
Total Experience Expected: 04-06 years
- Education: B.E./ B.Tech./ MCA
At our organization, we are committed to fighting against all forms of discrimination. We foster a work environment that is inclusive and respectful of all differences.
All of our positions are open to people with disabilities.
Discover what working at Sopra Steria looks like...
Are you looking for a place where you can free your creativity and take initiatives, supported by tech experts?
Join us on this adventure where every idea counts and every talent steps up.
Job offers that might interest you
Salary
Location
Chennai, Tamil Nadu, India
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
India
Description
Responsible for coding, unit testing, application development/support, bug fixing and deliver assigned tasks as per predefined timelines and quality standards.Must Have: Cobol, JCL and VSAM, Good To H
Reference
74cdb89b-11c4-4b47-b0b2-812c0bff43c5
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Noida, Uttar Pradesh, India
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Noida, Uttar Pradesh
Description
Job Description SFDC Configuration Custom fields, Custom objects, Validations, Object relationships, lightning app builderHands on experience in Approval Process, Process builder & FlowsHands on exper
Reference
6ed7fcbc-2066-48c2-ac7e-8df95ba60220
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Chennai, Tamil Nadu, India
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
India
Description
Total Experience Expected: 04-06 years Work location: Noida Work Mode: Hybrid (3 days at office a week) Shift: UK Shift JD for Performance Testing :Minimum 3-5 years of hands-on experience with
Reference
e648e7b0-0fea-420e-8b35-e367d66846c6
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Chennai, Tamil Nadu, India
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
India
Description
Must have skills· Minimum 5 Years Experienced resources with Hands on experience in CICS / VSAM· Good Analytical / Technical skills is a must· Resource should be willing to work in Shift
Reference
eb1409f4-3a91-45ee-b97a-8b96416cd74b
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Noida, Uttar Pradesh, India
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Noida, Uttar Pradesh
Description
Total Experience: 4yr to 8yr Work Location: Noida Mode of work: Hybrid (3 days at office a week) Shift Timing: UK Shift Mandatory Skills: PHP, MySQL, Apache Web Server, JavaScript, JQuery, Ubunt
Reference
8bc80975-e34f-4237-bd3c-99fc449b5a43
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Bengaluru, Karnataka, India
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Bengaluru, Karnataka
Description
Mandatory skillsKey Responsibilities:Design, develop, and execute test plans and test cases for embedded software.Improve code coverage metrics by updating and creating unit tests.Utilize tools such a
Reference
49851972-c79a-45d9-88bf-ad58bbfe7f74
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Noida, Uttar Pradesh, India
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Noida, Uttar Pradesh
Description
Role: AS 400 DeveloperExperience: 4 to 6 yearsLocation: Noida and ChennaiEducation: B.E./ B.Tech. / MCAPrimary Skills : AS400, OS400, Cobol, CL, DB2 Roles and Responsibilities:AS400 Development enviro
Reference
3c122dea-8d65-4c33-9c4a-a70555ec0820
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Bengaluru, Karnataka, India
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Bengaluru, Karnataka
Description
Embedded Tester (5 to 10 years) Mandatory Skills: Experience in DO178B/C, Embedded C Experience in Requirement Based Testing (SSIT and HSIT) Experience in Model Based Testing
Reference
71210620-d9e5-46ee-96b9-ef6ff9ee159d
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Noida, Uttar Pradesh, India
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Noida, Uttar Pradesh
Description
Total Experience Expected: 04-06 years ABAP expert on all RICEF areas. ABAP OOPs knowledge is required.ABAP 7.5 syntax and ABAP on HANA knowledge is big plus.
Reference
0bf4d662-a4df-4026-9a9a-3ee03742ee45
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Noida, Uttar Pradesh, India
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Noida, Uttar Pradesh
Description
Experience: 4 to 6 yearsStrong working experience on ABAP (RICEF) Objects on SAP S4 HANA systemProficient in OOABAP, IDOC and ABAP new syntaxMust have exposure to CDS View and AMDPGood to have knowled
Reference
515673c6-6481-46ce-bed7-f28022f6d854
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah Smith