Senior Data Engineer

Job not on LinkedIn

2 hours ago

🗽 New York – Remote

Although this job is listed in New York, this company may be open to hiring remote in other states.

💵 $110k - $140k / year

⏰ Full Time

🟠 Senior

🚰 Data Engineer

🦅 H1B Visa Sponsor

Apply Now

Receive Emails with Similar Jobs

Informa

WebsiteLinkedInAll Job Openings

B2B • Media • Education

Informa is a global leader in business intelligence, academic publishing, and events. It is home to hundreds of specialist brands and businesses, focused on connecting people with knowledge through events and digital products. Informa operates in over 30 countries and has a workforce of 12,000 colleagues globally. The company runs divisions such as Informa Markets, which facilitates trade and growth through events, and Taylor & Francis, a leading publisher of academic research. Informa prioritizes sustainability and diversity, aiming to positively impact markets and communities. As a member of the FTSE 100, Informa is known for its strong financial performance and scale within the academic and B2B markets.

10,000+ employees

Founded 1998

🤝 B2B

📱 Media

📚 Education

📋 Description

• Design, build, and maintain scalable and reliable data pipelines, including ingestion, storage, validation, governance, monitoring, and ELT patterns • Proactively identify opportunities and implement solutions to optimize pipeline operations and reduce manual work • Develop and maintain ETL data pipelines for large volumes of data, writing clean, maintainable, and efficient code • Maintain and evangelize high standards in software and data engineering best practices (SDLC, testing, scaling, performance) • Work closely with product managers, data scientists, and software engineers to create and prepare datasets from disparate sources to support the development and delivery of cutting-edge ML models and interactive applications • Proactively identify and implement new technologies and improve our reusable tools • Conduct code reviews and provide feedback • Participate in agile ceremonies • Stay current with emerging technologies and industry best practices

🎯 Requirements

• Advanced proficiency in Python and SQL • Required experience with Spark, including distributed computing and optimization • Preferred experience with Databricks (Unity Catalog, Feature Store, Delta Live Tables) • Extensive experience with data pipeline and workflow management tools (e.g., Airflow, Databricks, Glue) • Strong understanding of data engineering best practices (ETL/ELT, monitoring, observability, validations) • Experience with big data, scaling data processing, and distributed computing • Strong analytical skills—ability to explore, interpret, and transform raw data into structured, high-quality datasets that support business decisions and advanced analytics • Production support experience • Minimum 3+ years of professional experience • Self-discipline and eagerness to learn new skills, tools, and technologies • Solid verbal and written communication skills.

🏖️ Benefits

• Competitive benefits, including a range of Financial, Health and Lifestyle benefits to choose from • Flexible working options, including home working, flexible hours and part time options, depending on the role requirements – please ask! • Competitive annual leave, floating holidays, volunteering days and a day off for your birthday! • Learning and development tools to assist with your career development • Work with industry leading Subject Matter Experts and specialist products • Regular social events and networking opportunities • Collaborative, supportive culture, including an active DE&I program • Employee Assistance Program which provides expert third-party advice on wellbeing, relationships, legal and financial matters, as well as access to counselling services