Senior Data Engineer

Job not on LinkedIn

August 5

Apply Now

Receive Emails with Similar Jobs

1648 Factory

WebsiteLinkedInAll Job Openings

AI • B2B • SaaS

1648 Factory is a company specializing in staff augmentation and custom software development. They offer expert support, focusing on enhancing businesses with tailor-made AI solutions, designing market-ready digital products, and building innovative businesses leveraging cutting-edge technology. Their approach emphasizes collaboration to create impactful digital transformations for their clients.

51 - 200 employees

Founded 2020

🤝 B2B

☁️ SaaS

📋 Description

• Your role will be to build the data foundation and pipelines for a smart AI-driven agent that collects, structures, and analyzes operational and business data. • Design scalable data architectures and ETL/ELT pipelines using Azure and Databricks • Build hybrid pipelines integrating on-prem and cloud data sources (SQL Server, MongoDB, CosmosDB) • Apply CDC, Delta Lake, and medallion architecture principles • Optimize performance and costs: auto-scaling, caching, partitioning, Z-ordering, instance planning • Ensure data security and governance, including encryption, access control, and monitoring • Collaborate closely with AI/ML engineers for downstream LLM applications • Participate in CI/CD and infrastructure automation with DevOps • Strong communication and documentation skills • Ability to justify architectural decisions

🎯 Requirements

• 5+ years of experience in data engineering • Strong hands-on knowledge of: Azure Cloud, Databricks (Delta Lake, PySpark, performance tuning), Azure security practices (RBAC, Key Vault, encryption) • Proven experience with data migrations, especially from on-prem to Azure • Familiarity with hybrid data architecture • Understanding of cost and performance optimization techniques in big data workflows • CI/CD for data pipelines (Azure DevOps, GitHub Actions or similar) • English Upper-Intermediate+

🏖️ Benefits

• A working environment with plenty of scope for creativity. • Independent work with a well-rehearsed team in the background. • Remote work. • Super-experienced international team. • Trust and support from the management team. • High degrees of responsibility and autonomy. • Agile teams where your ideas and solutions are valued.