CUDA Engineer

🔥 2 minutes ago

🇧🇦 Bosnia and Herzegovina – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

👷🏻‍♀️ Engineer

👻 Ghost score 25%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

MWDN

WebsiteLinkedInAll Job Openings

51 - 200 employees

💼 Consulting

📦 Logistics

🏥 Healthcare

Consulting • Logistics • Healthcare

MWDN is a comprehensive IT services company that specializes in software development, web design, mobile development (iOS and Android), and desktop development. With over 200 in-house software engineers, MWDN provides a range of services including staff augmentation, dedicated teams, and global IT recruitment. Operating globally with delivery centers in Central and Eastern Europe, MWDN effectively bridges businesses in the USA, Europe, and Israel to top-tier tech talent while focusing on cost-effective solutions and personalized services tailored to client needs.

📋 Description

• Investigate and optimize LLM inference performance on modern GPUs • Work with inference and serving frameworks such as vLLM, SGLang, TensorRT-LLM, or similar systems • Analyze GPU execution, memory access patterns, kernel performance, and inference bottlenecks • Develop, optimize, debug, or reverse-engineer CUDA kernels and low-level GPU operations • Explore optimization techniques for matrix multiplication, attention mechanisms, and neural network layers • Benchmark performance and identify opportunities to improve latency, throughput, and GPU utilization • Work on technically challenging problems requiring analytical thinking and hands-on experimentation

🎯 Requirements

• Strong hands-on experience with CUDA and GPU programming • Deep understanding of GPU architecture, memory hierarchy, parallel execution, and performance optimization • Experience with LLM inference, AI systems, GPU kernels, or high-performance computing • Familiarity with vLLM, SGLang, TensorRT-LLM, Triton, or FlashAttention • Experience debugging complex performance issues and investigating low-level system behavior • Strong problem-solving skills • Ability to communicate complex technical concepts in English • PhD or research experience in Computer Science, Machine Learning, Computer Architecture, or a related field (nice to have) • Publications, research projects, or meaningful contributions to open-source GPU/LLM infrastructure (nice to have) • Experience with PyTorch internals, distributed inference, quantization, KV cache optimization, or custom GPU kernels (nice to have) • Contributions to vLLM, SGLang, Triton, FlashAttention, or related repositories (nice to have)

🏖️ Benefits

• Security through client vetting to minimize risks and ensure reliable, timely payments • Career support and help finding new opportunities if a project is not the right fit • Legal assistance with independent contractor or sole proprietorship status, taxes, and related processes • English courses and professional growth opportunities • Team-building events • Flexible working hours • 29 days of PTO (18 working days per year plus all national holidays) • 10 paid recovery days • Full financial and legal support for independent contractors • Free English classes with native speakers or Ukrainian teachers • Dedicated HR support