Apache Spark Module Lead
__jobinformationwidget.freetext.LocationText__
Chennai, Tamil Nadu, India
- Sopra Steria
- Engineering, Development, Applications
- 3 to 5 years
- Standard
- India
This vacancy has now expired. See all jobs
About Sopra Steria
Sopra Steria, a major Tech player in Europe with 56,000 employees in nearly 30 countries, is recognized for its consulting, digital services and software development. It helps its clients drive their digital transformation and obtain tangible and sustainable benefits. The Group provides end-to-end solutions to make large companies and organizations more competitive by combining in-depth knowledge of a wide range of business sectors and innovative technologies with a fully collaborative approach. Sopra Steria places people at the heart of everything it does and is committed to putting digital to work for its clients in order to build a positive future for all. In 2023, the Group generated revenues of €5.8 billion.
The world is how we shape it.
Data Engineer with Big Data development experience - (4-5 yrs. experience)
Required Skills:
- Strong expertise of programming languages – Python/Scala/others
- Hands-on experience in Spark with Scala and Python(PySpark) including Data frame core functions, SparkSQL, Spark Streaming and with HIVE, Hadoop, Kafka, YARN.
- Good Experience in Big data cloud platform, preferably Azure.
- Databricks and coding with notebooks.
- Hands-on experience with data orchestration tools such as Airflow, Apache NiFi
- Processing and manipulating data using SQL and Python code.
- Professional experience implementing data ingestion pipelines using Data Factory.
- Building and optimizing data pipelines, architectures, and data sets.
- Working knowledge of queueing, stream processing, and highly scalable data stores
- User training, customer support, and coordination with cross-functional teams.
- Writing database-heavy services or APIs.
- Strong understanding of structuring code for testability.
- Should be able to perform estimations, lead the team technically, Monitoring & Tracking of activities.
- Should be able to coordinate and communicate well with customer.
Good to have:
- Professional Data Engineer Certifications in Data Bricks.
- Familiarity with GIT workflow, CI/CD Pipelines.
- Working Knowledge of Azure DevOps environment.
- Experience of Agile practices & methodologies.
- Experience on Migration projects (Scala/PySpark).
- Flexibility to work in both support and development projects
Total Experience Expected: 04-06 years
- Education: B.E./ B.Tech./ MCA
At our organization, we are committed to fighting against all forms of discrimination. We foster a work environment that is inclusive and respectful of all differences.
All of our positions are open to people with disabilities.
Discover what working at Sopra Steria looks like...
Are you looking for a place where you can free your creativity and take initiatives, supported by tech experts?
Join us on this adventure where every idea counts and every talent steps up.
Job offers that might interest you
Salary
Location
Bengaluru, Karnataka, India
Vacancy language
English
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Sector
All Sectors
Remote
No
Location
Bengaluru, Karnataka
Description
Designing and developing server-side logic using Node.js for web applications and frontend components using Angular. Integrating user-facing elements developed by front-end developers with server-side
Reference
54a4aed1-a2f5-426b-8e7e-99cb7b5894f3
Expiry Date
Jan 1, 0001
Salary
Location
Bengaluru, Karnataka, India
Vacancy language
English
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Sector
All Sectors
Remote
No
Location
Bengaluru, Karnataka
Description
Catia DMU, CABIN, ESI, MSI Total Experience Expected: 02-04 years
Reference
7ef27f74-ad4e-4a15-bf20-b9b92ac95334
Expiry Date
Jan 1, 0001
Salary
Location
Bengaluru, Karnataka, India
Vacancy language
English
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Sector
All Sectors
Remote
No
Location
Bengaluru, Karnataka
Description
Good functional knowledge in standard SAP Production modules along with integration with other SAP modules. The relevant solution capabilities for the product are: Master Planning PP-MP Demand Manage
Reference
58f5e528-85f9-4efb-9a8d-cc609e20f7d6
Expiry Date
Jan 1, 0001
Salary
Location
Chennai, Tamil Nadu, India
Vacancy language
English
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Sector
All Sectors
Remote
No
Location
Chennai, Tamil Nadu
Description
We are looking for an experienced SSIS and MS SQL Developer to design, develop, and support SQL Server databases and SSIS packages. The role involves working on development projects and providing prod
Reference
d415d33d-33d5-488e-9221-7e791d6b72cc
Expiry Date
Jan 1, 0001
Salary
Location
Bengaluru, Karnataka, India
Vacancy language
English
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Sector
All Sectors
Remote
No
Location
Bengaluru, Karnataka
Description
CM, Catia DMU, CABIN, ESI, MSI Total Experience Expected: 04-06 years
Reference
ddab71ae-95c5-47eb-9426-2f7d98aa44fd
Expiry Date
Jan 1, 0001
Salary
Location
Noida, Uttar Pradesh, India
Vacancy language
English
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Sector
All Sectors
Remote
No
Location
Noida, Uttar Pradesh
Description
Description: Ideal candidate must be self-motivated with a proven track record in working on ServiceNow Platform Having an experience in ServiceNow Development from medium to complex needs. Able to Un
Reference
655f37c4-1a6f-4c4a-9f2e-7b57f2e12c80
Expiry Date
Jan 1, 0001
Salary
Location
Bengaluru, Karnataka, India
Vacancy language
English
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Sector
All Sectors
Remote
No
Location
Bengaluru, Karnataka
Description
Primary skills : Good programming skills on Python using Django framework Python Pandas & Asyncio FastAPI Ability to write complex SQL queries, stored procedures, functions PostgreSQL Good knowledge
Reference
f471cd51-5642-4ace-b0bc-890762a99375
Expiry Date
Jan 1, 0001
Salary
Location
Bengaluru, Karnataka, India
Vacancy language
English
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Sector
All Sectors
Remote
No
Location
Bengaluru, Karnataka
Description
Primary skills : Good programming skills on Python using Django framework Angular > 13.1 is a must Good knowledge on JavaScript is a must PostGres database knowledge is a must Mandatory Skills : Fro
Reference
fe206438-6d49-47bd-bf0d-8e4e7357a15d
Expiry Date
Jan 1, 0001
Salary
Location
Bengaluru, Karnataka, India
Vacancy language
English
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Sector
All Sectors
Remote
No
Location
Bengaluru, Karnataka
Description
Must Have: Front End: Angular Backend - C#, dotnet core,Asp.net core, Entity framework development Database: MS SQL Database and stored procedures. Good to Have: Knowledge on Powershell & Active dir
Reference
86d6fb94-0aeb-4e82-897e-4830a0d1a522
Expiry Date
Jan 1, 0001
Salary
Location
Bengaluru, Karnataka, India
Vacancy language
English
Job Type
Standard
Experience Level
3 to 5 years
Department
Engineering, Development, Applications
Brand
Sopra Steria
Sector
All Sectors
Remote
No
Location
Bengaluru, Karnataka
Description
Frontend - Angular Backend - Java Database - SQL Excellent grip on programming with Java and Angular Strong understanding of Java Frameworks Writing unit test cases for the backend code Writing cle
Reference
2f6374bb-6c09-4443-b2aa-9b8b7f013a2e
Expiry Date
Jan 1, 0001