AI Inference Engineer – QVAC

🔥 1 minute ago

🌏 Anywhere in the World

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

👻 Ghost score 25%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Tether.to

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2014

₿ Crypto

💳 Fintech

💸 Finance

Crypto • Fintech • Finance

Tether. to is a leading digital asset company that pioneers the use of stablecoins in the blockchain space. As the most widely adopted stablecoin, Tether tokens are designed to be pegged 1-to-1 with fiat currencies, offering a stable digital asset option for users. The platform facilitates these token transactions across multiple blockchains, enhancing cross-border transactions while maintaining transparency with daily records of total assets and reserves. Tether's initiatives include educational programs promoting digital asset usage, especially targeting regions like the Middle East, Turkey, and the Philippines. Tether thus positions itself as a disruptor in the traditional financial system by enabling a stable, efficient method of handling transactions in the digital currency world.

📋 Description

• Own the inference backbone behind QVAC’s local AI stack • Engineer the C++ systems layer for fast, reliable, and predictable model execution on user hardware • Optimize startup behavior, memory pressure, throughput, latency, and long-session stability • Define and evolve core abstractions for inference features • Deploy machine learning models to edge devices using llama.cpp and ggml • Port and enhance inference engines to run efficiently across different hardware • Collaborate with researchers on coding, training, and transitioning models from research to production • Integrate AI features into existing products • Ensure the inference layer is stable, optimized, and ready for stack integration

🎯 Requirements

• Strong programming skills in C++ • Strong experience with Llama.cpp and ggml inference engines • Experience with at least one GPU framework: CUDA, Vulkan, Metal, or OpenCL • Good understanding of deep learning concepts and model architectures • Experience with transformers, LLMs, and diffusion models • Demonstrated ability to rapidly assimilate new technologies and techniques • A degree in Computer Science, AI, Machine Learning, or a related field • Solid track record in AI R&D • Knowledge of training or fine-tuning LLMs is a bonus • Experience productionizing models is a bonus • Research experience in new model architectures is a bonus • Experience with distributed systems is a bonus • JavaScript experience is a bonus

🏖️ Benefits

• Remote work from anywhere in the world • Opportunity to collaborate with a global remote team • Work on private, on-device AI experiences and peer-to-peer AI products • Opportunity to contribute to innovative fintech, blockchain, AI, and digital asset products

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume