Senior AWS Data Engineer

Job not on LinkedIn

🕒 Yesterday

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Compass

WebsiteLinkedInAll Job Openings

10,000+ employees

🏠 Real Estate

📱 Media

Real Estate • Media

Compass is a real-estate-focused content and services site that provides detailed market analysis, buying/selling/renting guides, mortgage and financing information, and home improvement and renovation advice. The site offers resources for homebuyers, sellers, renters, agents, and real estate investors — including articles on appraisals, affordable housing, investment strategies, staging and property maintenance. Compass aims to help users make informed decisions across the housing lifecycle through timely market updates and practical how-to content.

📋 Description

• Develop new platform integrations with data consumption engines, focusing on Databricks, Glue ETL, and AWS Lambda; • Evolve proprietary APIs and event-driven workflows that support the platform; • Implement and automate provisioning of resources and permissions in a multi-account AWS environment; • Enhance the data virtualization and sharing mechanism between producers and consumers, based on data contracts; • Ensure observability, governance, and security of the platform; • Support producer and consumer teams in using the solution; • Participate in architecture decisions, technical documentation, and team mentoring.

🎯 Requirements

• Strong experience with AWS, particularly S3, Glue, Lake Formation, and IAM; • Experience with Databricks, including Unity Catalog and integration with Glue Catalog and Lake Formation; • Proficiency in Python for API development and automation; • Solid knowledge of Java for maintaining APIs and backend services; • Experience developing and maintaining REST APIs in production; • Experience with event-driven architectures using SNS and SQS; • Advanced SQL and experience with distributed query engines (Athena, Presto, Trino, and Spark); • Experience with multi-account AWS environments and cross-account access policies; • Nice-to-haves: knowledge of Data Mesh concepts, Data Products, and federated governance; experience with the Open Data Contract Standard; knowledge of PostgreSQL; experience with Infrastructure as Code (Terraform, CloudFormation, or CDK); experience with EMR (EC2 and Serverless) and Spark workload optimization; familiarity with AWS Lambda for event-driven pipelines; experience with Amazon Bedrock or other generative AI services on AWS.

🏖️ Benefits

• Position also open to candidates with disabilities (PwD)