Spark Scala Technical Lead
__jobinformationwidget.freetext.LocationText__
Noida, Uttar Pradesh, India
- Sopra Steria
- Engineering, Development, Applications
- 6 to 10 years
- Standard
- Noida, Uttar Pradesh
About Sopra Steria
Sopra Steria, a major Tech player in Europe with 56,000 employees in nearly 30 countries, is recognized for its consulting, digital services and software development. It helps its clients drive their digital transformation and obtain tangible and sustainable benefits. The Group provides end-to-end solutions to make large companies and organizations more competitive by combining in-depth knowledge of a wide range of business sectors and innovative technologies with a fully collaborative approach. Sopra Steria places people at the heart of everything it does and is committed to putting digital to work for its clients in order to build a positive future for all. In 2023, the Group generated revenues of €5.8 billion.
The world is how we shape it.
Lead Data Engineer with Big Data development experience - (6-8 yrs. experience)
Required Skills:
- Strong expertise of programming languages – Python/Scala/others
- Hands-on experience in PySpark including Data frame core functions SparkSQL, Spark Streaming and with HIVE, Hadoop, Kafka, YARN.
- Good Experience in
- Big data cloud platform, preferably Azure.
- Databricks and coding with notebooks.
- Airflow, Apache NiFi
- processing and manipulating data using SQL and Python code.
- Professional experience implementing data ingestion pipelines using Data Factory.
- Building and optimizing data pipelines, architectures, and data sets.
- Working knowledge of queueing, stream processing, and highly scalable data stores
- User training, customer support, and coordination with cross-functional teams.
- Writing database-heavy services or APIs.
- Strong understanding of structuring code for testability.
- Should be able to perform estimations, lead the team technically, Monitoring & Tracking of activities.
- Should be able to coordinate and communicate well with customer.
Good to have:
- Professional Data Engineer Certifications in Data Bricks.
- Familiarity with GIT workflow, CI/CD Pipelines.
- Working Knowledge of Azure DevOps environment.
- Experience of Agile practices & methodologies.
- Experience on Migration projects (Scala/PySpark).
- Flexibility to work in both support and development projects
Total Experience Expected: 06-08 years
- Education: B.E./ B.Tech./ MCA
At our organization, we are committed to fighting against all forms of discrimination. We foster a work environment that is inclusive and respectful of all differences.
All of our positions are open to people with disabilities.
Discover what working at Sopra Steria looks like...
Are you looking for a place where you can free your creativity and take initiatives, supported by tech experts?
Join us on this adventure where every idea counts and every talent steps up.
Job offers that might interest you
Salary
Location
Noida, Uttar Pradesh, India
Job Type
Standard
Experience Level
6 to 10 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Noida, Uttar Pradesh
Description
This position is responsible for the design and development of Oracle Financial Consolidation and Close Cloud (FCCS). This position will collaborate with various technical experts within our organizat
Reference
abe1f0e9-4fb6-4ffe-a575-f5a654607dec
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Noida, Uttar Pradesh, India
Job Type
Standard
Experience Level
6 to 10 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Noida, Uttar Pradesh
Description
Job Overview:Seeking a skilled Functional Analyst with expertise in Oracle PPM having at least 5 years of support or implementation experience in Oracle Cloud PPM. In this role, individuals will be re
Reference
b8b6d9c8-9b32-4c43-b8f3-23dd30590f5b
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Noida, Uttar Pradesh, India
Job Type
Standard
Experience Level
6 to 10 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Noida, Uttar Pradesh
Description
Description:Ideal candidate must be self-motivated with a proven record of accomplishment in working on ServiceNow Platform.Having an experience in ServiceNow Development from medium to complex needs.
Reference
e23556b2-25e8-4088-98a2-793826bcd1d0
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Noida, Uttar Pradesh, India
Job Type
Standard
Experience Level
6 to 10 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Noida, Uttar Pradesh
Description
Experience: 6 to 8 yearsStrong working experience on ABAP (RICEF) Objects on SAP S4 HANA systemProficient in OOABAP, IDOC, ODATA and ABAP new syntaxMust have exposure to CDS View and AMDPGood to have
Reference
bd20d76e-ef80-4f2f-8da8-c18a298fc909
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Noida, Uttar Pradesh, India
Job Type
Standard
Experience Level
6 to 10 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Noida, Uttar Pradesh
Description
Having experience in ServiceNow Development and ability to drive solutions independently.Has worked on ITSM extensively and understanding of CMDB. Also, is aware of other ServiceNow products and havin
Reference
3891e08e-cb48-4e45-a3d2-aa4307a7e273
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Noida, Uttar Pradesh, India
Job Type
Standard
Experience Level
6 to 10 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Noida, Uttar Pradesh
Description
We are seeking an experienced SAP Functional Consultant with expertise in Material Management (MM) and Warehouse Management (WM), along with a basic understanding of Extended Warehouse Management (EWM
Reference
568617ee-fc0f-408a-b11e-44471e968b00
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Noida, Uttar Pradesh, India
Job Type
Standard
Experience Level
6 to 10 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Noida, Uttar Pradesh
Description
Description:Ideal candidate must be self-motivated with a proven track record in working on ServiceNow PlatformHaving an experience in ServiceNow Development from medium to complex needs.Able to Under
Reference
655f37c4-1a6f-4c4a-9f2e-7b57f2e12c80
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Noida, Uttar Pradesh, India
Job Type
Standard
Experience Level
6 to 10 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Noida, Uttar Pradesh
Description
Having experience in ServiceNow Development and ability to drive solutions independently.Has worked on ITSM extensively and understanding of CMDB. Also, is aware of other ServiceNow products and havin
Reference
7a210375-bcab-4b87-9d66-835397ccb070
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Noida, Uttar Pradesh, India
Job Type
Standard
Experience Level
6 to 10 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Noida, Uttar Pradesh
Description
Description:Ideal candidate must be self-motivated with a proven track record in working on ServiceNow PlatformHaving an experience in ServiceNow Development from medium to complex needs.Able to Under
Reference
4af38e1c-3c6f-4d77-894d-7150538a1536
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah SmithSalary
Location
Noida, Uttar Pradesh, India
Job Type
Standard
Experience Level
6 to 10 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Location
Noida, Uttar Pradesh
Description
Roles and Responsibilities Implementation projects for clients from various industries that process data at various levels of complexity. Translate complex functional and technical requirements into d
Reference
d5f32973-2178-4b15-ba5a-5622d04bcd6a
Expiry Date
Jan 1, 0001
Author
Sarah SmithAuthor
Sarah Smith