Data Operations Specialist

Job not on LinkedIn

🔥 1 minute ago

🇺🇸 United States – Remote

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

⚙️ Operations

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 11%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Scicom Infrastructure Services

WebsiteLinkedInAll Job Openings

11 - 50 employees

🏢 Enterprise

☁️ SaaS

🤝 B2B

Enterprise • SaaS • B2B

Scicom Infrastructure Services is an industry-leading technology consulting and services organization. The company is focused on delivering high-quality, reliable, and cost-effective technology solutions to support the business objectives of leading private and public sector organizations. Scicom provides a range of services including enterprise performance management, managed services, enterprise architecture, project management, infrastructure management, and application management. They collaborate with companies like AppDynamics, BigPanda, DataDog, and AWS for business and application performance, event correlation and automation, enterprise monitoring, cloud monitoring, and ITSM solutions. Scicom offers global, 24/7 operational support and is recognized for its ability to support global infrastructure effectively. The company has been named one of the fastest-growing private companies in America by Inc 5000 in multiple years.

📋 Description

• Monitor the health, availability, performance, and capacity of Databricks workspaces, jobs, pipelines, clusters, SQL warehouses, and related cloud services • Provide day-to-day operational support for production Databricks environments • Monitor and troubleshoot ETL, ELT, streaming, API, and file-based data pipelines • Restart, rerun, recover, reprocess, backfill, reconcile, and remediate failed workflows and data loads • Review driver and executor logs, Spark UI metrics, cluster event logs, audit logs, and application telemetry to identify root causes • Support Databricks Workflows, Lakeflow, Delta Live Tables, Auto Loader, Structured Streaming, and batch-processing workloads • Maintain cluster, serverless compute, instance pool, cluster policy, SQL warehouse, and environment configurations • Coordinate platform upgrades, runtime and library updates, deployments, releases, changes, rollbacks, and post-deployment monitoring • Serve as first- or second-level support for production incidents; triage, coordinate response, provide status updates, escalate, and conduct root-cause analyses • Maintain incident, problem, service-request, change, deployment, and operational records • Develop and maintain dashboards, alerts, operational reports, health indicators, SLIs, and SLOs • Monitor job success, latency, processing duration, utilization, freshness, quality, and compute consumption • Validate data contracts, schemas, record counts, control totals, data quality, lineage, audit evidence, and governance requirements • Support identity, access, entitlement, Unity Catalog, secrets, security, privacy, backup, recovery, retention, archival, and disaster-recovery activities • Analyze resource consumption, job duration, query performance, storage, and workload patterns; recommend cost and performance optimizations • Create and maintain operational procedures, troubleshooting guides, escalation matrices, runbooks, inventories, configuration documentation, and recovery requirements • Identify automation and continuous-improvement opportunities and participate in operational-readiness reviews

🎯 Requirements

• Bachelor’s degree in computer science, information technology, data engineering, information systems, or a related field, or equivalent professional experience • At least four years of experience in data operations, production support, data engineering, cloud operations, DevOps, platform support, or a related technical role • At least two years of hands-on experience supporting Databricks environments or production Databricks workloads • Experience supporting production ETL, ELT, batch, or streaming data pipelines • Working knowledge of Databricks, Apache Spark, PySpark or Python, SQL, Delta Lake, Databricks Workflows or Jobs, cloud object storage, data pipeline monitoring, log analysis, and troubleshooting • Experience investigating failed jobs, delayed pipelines, schema issues, data discrepancies, and performance problems • Familiarity with medallion architecture and Bronze, Silver, and Gold data layers • Experience with at least one major cloud platform: Microsoft Azure, AWS, or Google Cloud • Experience using ticketing and service-management tools such as ServiceNow, Jira, or a comparable platform • Experience with monitoring, alerting, logging, or observability tools • Understanding of incident, problem, change, and release-management processes • Ability to write and maintain technical procedures and operational documentation • Strong analytical, organizational, communication, and troubleshooting skills • Ability to work effectively with engineers, business analysts, architects, security teams, and nontechnical stakeholders • Ability to support multiple production priorities in a structured and timely manner • Preferred: Databricks Certified Data Engineer Associate or Professional; Databricks Certified Associate Developer for Apache Spark; Microsoft Azure, AWS, or Google Cloud certification • Preferred: Experience with Unity Catalog, Delta Live Tables, Lakeflow, Auto Loader, Structured Streaming, Databricks SQL, cloud services, CI/CD tools, observability platforms, APIs, Kafka, Event Hubs, Kinesis, Airflow, dbt, Snowflake, Power BI, data contracts, schema registries, metadata management, data lineage, data-quality frameworks, OCDS, procurement, contracting, financial or public-sector data, regulated or high-security environments, SLAs and 24-hour support, disaster recovery, backup, archival, and operational-resilience testing