Senior Data Engineer

Job not on LinkedIn

September 10

🗽 New York – Remote

Although this job is listed in New York, this company may be open to hiring remote in other states.

⏰ Full Time

🟠 Senior

🚰 Data Engineer

Apply Now

Receive Emails with Similar Jobs

Curotec

WebsiteLinkedInAll Job Openings

SaaS • Software Development • AI/ML

Curotec is a product development company specializing in software solutions. They provide teams with expertise in web and mobile development, AI/ML capabilities, and e-commerce solutions. Curotec aims to partner with enterprises and product teams to drive efficiency and innovation in their projects, leveraging their experience in various technologies such as Laravel, Python, and Node. js to ensure successful outcomes for their clients.

51 - 200 employees

Founded 2010

☁️ SaaS

📋 Description

• Support the ingestion, processing, and synchronization of data across the analytics platform • Build and maintain Python Notebooks to ingest data from third-party APIs • Design and implement Medallion layer architecture (Bronze, Silver, Gold) for structured data organization and progressive data refinement • Store and manage data within Microsoft Fabric's Data Lake and Data Warehouse using delta parquet file formats • Set up data pipelines and sync key datasets to Azure Synapse Analytics • Develop PySpark-based data transformation processes across Bronze, Silver, and Gold layers • Collaborate with developers, analysts, and stakeholders to ensure data availability and accuracy • Monitor, test, and optimize data flows for reliability and performance • Document processes and contribute to best practices for data ingestion and transformation

🎯 Requirements

• Strong experience with Python for data ingestion and transformation • Proficiency with PySpark for large-scale data processing • Proficiency in working with RESTful APIs and handling large datasets • Experience with Microsoft Fabric or similar modern data platforms • Understanding of Medallion architecture (Bronze, Silver, Gold layers) and data lakehouse concepts • Experience working with Delta Lake and parquet file formats • Understanding of data warehousing concepts and performance tuning • Familiarity with cloud-based workflows, especially within the Azure ecosystem • Hands-on experience working with API-based data ingestion and modern data architectures • Nice to have: Experience with marketing APIs such as Google Ads or Google Analytics 4 • Nice to have: Familiarity with Azure Synapse and Data Factory pipeline design • Nice to have: Understanding of data modeling for analytics and reporting use cases • Nice to have: Experience with AI coding tools • Nice to have: Experience with Fivetran, Aribyte, and Riverly

🏖️ Benefits

• Competitive salary • Ability to grow and advance your career • Attend virtual developer conferences • Work on cutting-edge and exciting projects