Senior Engineer - IT

Chennaionsitesenior

Posted today · via Workday

About this role

Job Description: Key Responsibilities Design, develop, and maintain scalable data pipelines using Databricks and PySpark Build robust ETL/ELT workflows for batch and near real‑time data processing Write optimized and efficient SQL queries for data transformation, validation, and analysis Work with large-scale distributed datasets using Spark-based processing frameworks Perform data ingestion from multiple sources (APIs, files, databases) into data lake/lakehouse architecture Ensure data quality, integrity, and consistency through validations and monitoring Optimize pipeline performance and cost (partitioning, caching, query tuning, etc.) Collaborate with cross-functional teams (Data Ops, Business, Analytics) to deliver data solutions Troubleshoot pipeline failures and implement proactive m…

Read the full description on The Guardian Life Insurance Company Of America's site →

What we'd score you on

reqspace match rubric

Five dimensions, recruiter-grade. Upload your resume and we'll generate a written explanation of where you fit and where the gaps are.

1

Skills match

For this role: sql, databricks, aws, jenkins, spark…

2

Level fit

This role is senior-level. We check your trajectory against it.

3

Domain experience

Your work in the role's domain matters more than your years total. We weight recent and direct experience.

4

Recency

A skill you used last quarter weighs more than one from five years ago. We grade on recency, not lifetime.

5

Location fit

This role is based in Chennai. We weight your proximity and willingness to relocate.

Score yourself on this role.
Free · no card · written explanation included
See if I'm a fit →

Skills in this role

Pulled from the job description. These are the keywords we'll weight when scoring your fit.

sqldatabricksawsjenkinssparkpysparkgitteamsworkday

More at The Guardian Life Insurance Company Of America

See all open jobs at The Guardian Life Insurance Company Of America