Senior Data Integration Engineer (Databricks)

Tech Stack

SQL
PYTHON
AWS
ETL TOOLS
DATA WAREHOUSING
AZURE
DATABRICKS

Job Description

We are looking for a Senior Data Integration Engineer to join the dynamic Data Practice team and collaborate on EPAM strategic projects.As a Senior Data Integration Engineer, your key role will be to build data systems and applications that drive decision-making.

You will primarily focus on developing and maintaining data pipelines and data-driven solutions in public clouds like AWS or Azure, as well as migrating data from the on-premises data centers to the cloud.

Additionally, you will build components for enterprise data platforms.RESPONSIBILITIESPlay a key role in driving forward EPAM strategic data projectsDesign, build, and manage enterprise data solutions in Public Cloud (AWS, Azure)Develop components for the enterprise data platform to ensure data accuracy and availabilityCollaborate with data scientists, data architects, and others ensure data needs are metImplement secure and auditable data processes to ensure data integrityTroubleshoot any data-related issues and strive to improve the quality of data systemsREQUIREMENTSProven experience as a Data Engineer or similar role for at least 3 yearsProficiency in SQL and PhytonProven experience with Public Cloud (AWS, Azure), DBMS and ETL/ELT toolsHands-on experience with DatabricksExperience in data acquisition (API calls/FTP downloads), ETL, transformation/normalization (from raw to DB table schema structure), storage (Raw files, Database server), distribution & access (Entitlements for users, build of API’s and access points for data)Experience building components for enterprise data platform (Data Warehouses, Operational Data Stores, Access layers with APIs, file extracts, user queries)A bachelor's degree in computer science, IT, or a related fieldStrong communication skillsWE OFFERWe gather like-minded people:Engineering community of industry professionalsFriendly team and enjoyable working environmentFlexible schedule and opportunity to work remotely within PolandChance to work abroad for up to 60 days annuallyRelocation within our 50+ officesWe provide growth opportunities:Outstanding career roadmapLeadership development, career advising, soft skills, and well-being programsCertification (GCP, Azure, AWS)Unlimited access to LinkedIn Learning, Get Abstract, O’Reilly, Cloud GuruLanguage classes in English and Polish for foreignersWe cover it all:Stable income (Employment Contract or B2B)Participation in the Employee Stock Purchase PlanBenefits package (health insurance, multisport, shopping vouchers)Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and moreReferral bonusesCorporate, social and well-being eventsPlease, note:The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interviewWe will reach out to selected candidates exclusively