DATA ENGINEER
New Yorkonsitemid
Posted 121mo ago · via Smartrecruiters
About this role
About Major Corporation Responsibilities: Design and develop high-throughput, low-latency data processing pipelines to quickly ingest and make data available on the platform across various distributed data stores Analyze large datasets to identify opportunities to tune and improve the system Experiment with various Hadoop frameworks like Hive, Pig and Scalding to identify the optimal approach for extracting valuable insights from massive datasets Tool We Used: Scala Hadoop (Hive, Pig, Scalding, Spark) Kafka MySQL, Redis, Vertica, Aerospike Qualifications Requirements: Bachelors or Masters in Computer Science or related field 3+ years of experience ingesting, processing, storing and querying large datasets Professional Hadoop ecosystem experience, including storage optimization and job perf…
What we'd score you on
reqspace match rubricFive dimensions, recruiter-grade. Upload your resume and we'll generate a written explanation of where you fit and where the gaps are.
1
Skills match
For this role: python, java, scala, mysql, redis…
2
Level fit
This role is mid-level. We check your trajectory against it.
3
Domain experience
Your work in the role's domain matters more than your years total. We weight recent and direct experience.
4
Recency
A skill you used last quarter weighs more than one from five years ago. We grade on recency, not lifetime.
5
Location fit
This role is based in New York. We weight your proximity and willingness to relocate.
Score yourself on this role.
Free · no card · written explanation included
Skills in this role
Pulled from the job description. These are the keywords we'll weight when scoring your fit.
pythonjavascalamysqlredissparkhadoophivekafka
More at Carnegieaffiliates
- View →Build & Release EngineerNew York, NY, United States
- View →C# .Net WPF DevelopersParsippany-Troy Hills, NJ, United States
- View →Business Analyst - Healthcare ITNew York, NY, United States
- View →Security EngineerNew York, NY, United States
- View →Information Security Engineer - new positionNew York, NY, United States
- View →JAVA IntegrationNew York, NY, United States