Data Engineer

Job not on LinkedIn

🔥 3 minutes ago

🇺🇸 United States – Remote

💵 $72.5k - $160.7k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

👻 Ghost score 11%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

LouisianaNOW.Jobs

WebsiteLinkedInAll Job Openings

51 - 200 employees

🎯 Recruiter

🏪 Marketplace

Recruitment • Marketplace

LouisianaNOW. Jobs is a regional jobs portal and talent attraction site focused on connecting job seekers to employers and economic opportunities across Louisiana. The site highlights regional communities, industry sectors, current employers who are hiring, career advice articles, and job listings, and appears to be operated or supported by LED FastStart (Louisiana Economic Development). It’s positioned as a marketplace that promotes Louisiana’s growing industries and helps match talent with local openings and employer investment announcements.

📋 Description

• Design, develop, and maintain Azure Databricks pipelines for credit card data ingestion, transformation, integration, and downstream consumption • Develop scalable processing solutions using PySpark, Python, Spark SQL, SQL, Delta Lake, and ADLS for high-volume card datasets • Build transformation logic for cardholder, account, transaction, authorization, payment, balance, fee, interest, rewards, and servicing data • Translate business requirements and source-to-target mappings into reusable Databricks notebooks, workflows, jobs, and ETL/ELT processes • Support credit card platform conversion and modernization, including data mapping, historical/incremental loads, transformation, and reconciliation • Implement automated data quality, balancing, reconciliation, cleansing, and exception-handling controls across source and target environments • Protect sensitive cardholder information, including PAN and PCI-sensitive data, through masking, tokenization, encryption, and appropriate data-handling practices • Troubleshoot and optimize Databricks pipelines • Collaborate with credit card SMEs, architects, analysts, and application teams • Build innovative solutions and relationships with teammates and clients while accessing global capabilities

🎯 Requirements

• 5+ years of Data Engineering, ETL/Data Warehouse, or Big Data experience, including 3+ years of hands-on Azure Databricks development • Strong hands-on development experience with Databricks, PySpark, Python, Spark SQL, SQL, Delta Lake, and ADLS • Experience designing and developing scalable ETL/ELT pipelines for large-volume transactional and financial datasets • Strong experience with data transformation, source-to-target mapping, cleansing, reconciliation, data quality, and exception handling • Credit card/payments domain experience with knowledge of card accounts, transactions, authorizations, payments, balances, billing, and settlement • Experience with Azure DevOps, Git, CI/CD, and Agile/Scrum development practices • Strong banking/financial services experience and understanding of financial data controls and reconciliation • Experience with TSYS or another major credit card processing platform preferred • Experience supporting credit card conversions, migrations, or platform modernization preferred • Knowledge of the end-to-end card lifecycle preferred • Experience with Mastercard and/or Visa data, interfaces, reporting, rewards, or loyalty programs preferred • Understanding of PCI DSS, PAN protection, tokenization/detokenization, encryption, and sensitive cardholder data management preferred • Experience with advanced Databricks capabilities such as Unity Catalog, Workflows, Auto Loader, and Lakeflow/Delta Live Tables preferred • Experience modernizing Informatica PowerCenter or SSIS workloads to Databricks/PySpark preferred • Azure and/or Databricks certifications and experience with large-scale banking conversion initiatives preferred • Ability to successfully complete a background investigation • Qualified applicants must meet applicable U.S. employment requirements

🏖️ Benefits

• Competitive compensation • Comprehensive insurance options • Matching contributions through the 401(k) plan and the share purchase plan • Paid time off for vacation, holidays, and sick time • Paid parental leave • Learning opportunities and tuition assistance • Wellness and Well-being programs • Ownership opportunity from day 1 through CGI Partners model • Global capabilities and industry and technology expertise • Career development and skill-building opportunities • Reasonable accommodations for qualified individuals with disabilities