Middle Data Engineer

Project overview

Required skills — 3+ years of experience in data engineering creating or managing end-to-end data pipelines on large complex datasets. — Proficiency in Spark — Expertise in Scala, and/or Python — Fluency with at least one dialect of SQL — Level of English: Upper-Intermediate As a plus — Experience with Streaming platforms, typically based around Kafka — Experience in Terraform, Airflow — Strong grasp of AWS data platform services and their strengths/weaknesses — Strong experience using Jira, Slack, JetBrains IDEs, Git, GitLab, GitHub, Docker, Jenkins — Experience using DataBricks Responsibilities — Manage data quality and integrity — Assist with building tools and technology to ensure that downstream customers can have faith in the data they’re consuming — Cross-functional work with the Data Science or Content Engineering teams to troubleshoot, process, or optimize business-critical pipelines — Work with Core Platform to implement better processing jobs for scaling the consumption of streaming data sets We offer — High compensation according to your technical skills — Long-term projects (12m+) with great Customers — 5-day working week, 8-hour working day, flexible schedule — Democratic management style & friendly environment — WFH mode — Annual Paid vacation — 30 b/days + unpaid vacation — Paid sick leaves — 6 b/days per year — Corporate Perks (external training, English course, business speaking club, corporate events/team buildings) — Professional and personal growth Who we are? KitRUM is a one-stop custom software development company headquartered in sunny Florida with development centers in Ukraine and Poland. With a pool of 300+ top-notch engineering resources, we help Cxos of vc-backed startups and fast-growing tech companies in the us, eu and australia to custom build software engineering teams packed with top-tier talent. Why us? We realize that one of the most crucial things for developers — adequate client and fascinating project. So we qualify our Clients to make sure that they: — have an idea that they believe will make the world a better place; — think long-term and looking for a trusted-tech partner; — want to rely on and avoid micromanaging; — are not f$%$ing jackasses :-) Our site: https://kitrum.com/

Category IT & Programming
Subcategory Other
Project size Large
Is this a project or a position? Project
Required availability As needed

Delivery term: Not specified

Skills needed