Senior Data Engineer

🔥 31 minutes ago

🌐 United Kingdom, Portugal – Remote

🇬🇧 United Kingdom – Remote 🇵🇹 Portugal – Remote

⏰ Full Time

🟠 Senior

🚰 Data Engineer

🇬🇧 UK Skilled Worker Visa Sponsor

This company has sponsored UK Skilled Worker visas in the past.

👻 Ghost score 10%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.Why this score:

• Just posted.
• Jobs at this company usually fill in 41 days.
• No salary listed.

Apply Now

Find Similar Remote Jobs

proSapient

WebsiteLinkedInAll Job Openings

201 - 500 employees

🤖 Artificial Intelligence

💼 Consulting

💰 $10M Series A on 2021-01

Artificial Intelligence • Consulting

proSapient is a comprehensive primary research and expert networking service that connects institutional investors, consultants, and corporate clients with industry professionals globally. By leveraging advanced technology driven by artificial intelligence, proSapient delivers actionable intelligence and relevant expert connections quickly and accurately, providing clients with a significant advantage in achieving their commercial goals.

📋 Description

• Build and operate batch and real-time pipelines feeding matching and search systems. • Work with real-time data streams and search infrastructure using Kafka and Elasticsearch. • Model datasets consumed by the product layer, including candidate features, interaction events and ranking signals, while maintaining stable contracts. • Own production pipelines, including monitoring, alerting, backfills and on-call support. • Instrument recruiter and client behaviour so matching quality can be measured and improved. • Build event pipelines supporting CSAT and workflow metrics. • Conduct and analyse experiments to iterate on data-processing pipeline quality and make experiment data queryable. • Add data-quality checks and tests at important boundaries and make failures visible. • Reduce relevant cost and latency. • Partner with QA to make data correctness testable. • Identify and provide useful internal or external data sources for structured search and GenAI tools. • Work directly with the Lead Search Engineer, AI/ML Engineer and Product Manager on a frequently shipping team.

🎯 Requirements

• 5+ years building production data pipelines. • Strong Python programming skills, with practical experience writing clean, production-ready code. • Strong SQL and proficiency with PostgreSQL or other relational databases. • Strong hands-on experience with Elasticsearch / OpenSearch, including performance optimisation and query tuning. • Deep understanding of both batch and event/streaming patterns, and a clear sense of when each is appropriate. • Practical data modelling skills for analytics and for serving application features. • Experience operating your own pipelines in production, alongside comfort working in a codebase with tests, code review and CI. • Message brokers like Kafka or RabbitMQ (nice to have). • Cloud data warehouse experience, with BigQuery preferred and equivalents acceptable (nice to have). • Docker, Kubernetes, and cloud environments such as AWS and/or GCP (nice to have). • Experience feeding search, ranking or ML systems specifically (nice to have). • Building LLM-based extraction or enrichment pipelines (nice to have). • Experience with dbt or a comparable transformation framework (nice to have). • Observability tools such as Prometheus or Datadog and background job processing frameworks (nice to have). • Exposure to Elixir services (nice to have).

🏖️ Benefits

• Tenure gifts, including vouchers, extra holiday and sabbaticals for each year of employment. • Health insurance through Vitality. • Remote working for up to 20 days each year, giving you flexibility and a change of scenery. • Employee Assistance Programme with personalised health and wellbeing advice from specialist teams. • Enhanced maternity and paternity pay. • 25 days’ annual leave plus bank holidays, including a week’s closure over Christmas. • MyMindPal app for online mental fitness support. • Corporate events, from quarterly gatherings to annual winter and summer parties.

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume