Phyton with Spark Developer

Chennaionsitemid

Posted 4w ago · via Workable

See if I'm a fit →Tailor my resume for this role →Apply on Workable ↗

About this role

Responsibilities Direct Responsibilities · Design & develop robust ingestion, transformation, and enrichment pipelines with Python, PySpark, and SQL. Write and optimize complex SQL queries, analytical UDFs, and window functions for data aggregation and reporting. Collaborate with CEFS data architects, data scientists, and business analysts to translate functional requirements into technical specifications. Unit‑test, integrate‑test, and review code. Maintain CI/CD pipelines (Git, Jenkins, Docker) for automated build, test, and deployment of jobs. Monitor production workloads and troubleshoot performance bottlenecks, memory issues, and job failures. Document data lineage, pipeline design, and operational run‑books in Confluence/SharePoint.…

Read the full description on Infotel UK's site →

What we'd score you on

reqspace match rubric

Five dimensions, recruiter-grade. Upload your resume and we'll generate a written explanation of where you fit and where the gaps are.

Skills match

For this role: python, shell, sql, restful, docker…

Level fit

This role is mid-level. We check your trajectory against it.

Domain experience

Your work in the role's domain matters more than your years total. We weight recent and direct experience.

Recency

A skill you used last quarter weighs more than one from five years ago. We grade on recency, not lifetime.

Location fit

This role is based in Chennai. We weight your proximity and willingness to relocate.

Score yourself on this role.

Free · no card · written explanation included

See if I'm a fit →

Skills in this role

Pulled from the job description. These are the keywords we'll weight when scoring your fit.

pythonshellsqlrestfuldockerjenkinssparkpysparkpandasnumpygitbitbucketmaven

More at Infotel UK

See all open jobs at Infotel UK →