Hi Sir,
Please find the requirement below , If you find yourself comfortable with the requirement please reply with your updated resume and I will get back to you
Position : Data Engineer
Location : Remote
Duration : 6-12 Months
Interview : Phone and Skype
W2 role
Candidates from FAANG, Magnificent Seven, and MANGO will get priority. Followed by candidates that come from technology companies
Job Description:
Must haves:
Azure Data Engineering
Scala
spark
Job Description:
Top 3 Must-Have Hard Skillsets
• Big Data Platform Experience && Minimum 5 years
Cosmos (MapReducer), Azure data stack (HDI, ADLS Gen2), Spark/Scala.
2. SQL + High-Level Programming Language && Minimum 5 years
SQL queries plus experience in C#, Scala, Java, or Python (flexible, not a deal breaker).
3. CICD, Debugging && Troubleshooting — Minimum 5 years
Strong debugging, monitoring, and engineering lifecycle skills.
Typical Day
Will work with one of the engineers and engineering manager && responsible for feature design, development, validation, CI/CD, bug fixes, troubleshooting && debugging issues
Follow engineering practice and deployment rules,
SAW device is needed
Key Projects
• Security work: fixing code security issues, updating identities/secrets, ensuring secure endpoints.
• Governance: data partitioning, physical access restrictions, compliance related updates.
• Feature innovation && continuous platform enhancements.
• Maintaining && improving pipelines across Cosmos (MapReducer) and Azure data platforms (HDI, ADLS Gen2, Spark).
Typical Task Breakdown && Operating Rhythm
• 15–20% security-related fixes (code vulnerabilities, endpoint issues, secret rotation).
• Governance && compliance work (data partitioning, access control).
• Writing, modifying, && debugging code and services.
• CICD, monitoring, && standard engineering lifecycle practices.
• Mostly heads down execution work, following a task list && completing high priority deliverables quickly.
• Collaborating with FTEs who && will help onboard and accelerate ramp up.
• Using SAW device access for AME domain work (pre prod/prod as allowed).
Ideal Background
Distributed system design && implementation, BIG DATA platforms knowledge, CI/CD processes, debugging && troubleshooting skills
Disqualifiers
• Long ramp up timeline or lack of experience && large scale data platforms.
• No experience && high reliability data engineering environments.
• Inability to work independently && heavy execution demands.
• Lack && any programming language + SQL exposure (manager expects at least a foundational high level language).
Best vs. Average Candidate
• Best: Has 5–7 yrs && large scale data engineering (Cosmos, Azure, Spark).
o Strong SQL + one high level language (C#, Scala, Java, Python).
o Prior Microsoft experience (S360, security expectations, internal processes).
o Very fast ramp up && can immediately execute tasks independently.
Thanks,
Neeraj
It Resource Manager
Pioneer IT Systems
Email:
Mobile :
Apply Now
Apply Now