
51 - 200 employees
🤖 Artificial Intelligence
📱 Media
💼 Consulting
Artificial Intelligence • Media • Consulting
SemiAnalysis is an independent research and advisory firm focused on semiconductors, AI infrastructure, and datacenter economics. It publishes a technology newsletter and institutional research, and provides market models, benchmarks, data APIs, and consulting services.
🔥 3 minutes ago
🌐 United States, Mexico, +1 more countries – Remote
🗽 New York – Remote
⏰ Full Time
🔴 Lead
🖥 Software Engineer
👻 Ghost score 15%
Where this job comes from
Posted on SemiAnalysis's careers page ↗, not through a job board
First seen by Remote Rocketship 3 minutes ago

51 - 200 employees
🤖 Artificial Intelligence
📱 Media
💼 Consulting
Artificial Intelligence • Media • Consulting
SemiAnalysis is an independent research and advisory firm focused on semiconductors, AI infrastructure, and datacenter economics. It publishes a technology newsletter and institutional research, and provides market models, benchmarks, data APIs, and consulting services.
• Build first-principles performance models for LLM inference and training • Analyze arithmetic intensity, roofline performance, prefill and decode behavior, KV cache capacity, memory bandwidth, batching, parallelism, and latency-throughput trade-offs • Evaluate GPUs, TPUs, custom ASICs, emerging accelerators, HBM, on-chip SRAM, memory tiering, scale-up fabrics, scale-out networks, racks, pods, and datacenters • Assess architecture and system design trade-offs involving compute, memory bandwidth, interconnect topology, power, cooling, and workload suitability • Connect semiconductor manufacturing decisions to hardware performance, availability, and cost • Analyze process nodes, die size, reticle limits, advanced packaging, 2.5D integration, 3D stacking, HBM integration, yield, and silicon economics • Examine chip, system, rack, and cluster announcements using specifications, die shots, rack layouts, benchmarks, and network diagrams • Develop independent views on real-world performance compared with vendor claims • Validate internal models against benchmarks and independently gathered performance data • Investigate differences between theoretical peak performance and delivered application performance • Translate technical analysis into tokens-per-second-per-watt, per-dollar-of-capital-expenditure, and per-megawatt metrics • Contribute to TCO, tokenomics, accelerator, memory, networking, and datacenter research • Publish detailed research on AI accelerators, systems, infrastructure, and performance • Act as a technical authority during client calls, briefings, and discussions with engineering and investment audiences • Collaborate with accelerator, memory, networking, semiconductor, and datacenter analysts • Support SemiAnalysis products and research, including the Inference Simulator, InferenceX, Tokenomics Model, Accelerator & HBM Model, and AI Cloud TCO research • Potentially define and own a research coverage area based on technical strengths
• Deep technical understanding of modern compute hardware at one or more levels of the stack, including silicon, systems, networking, clusters, or datacenters • Strong interest in learning unfamiliar parts of the hardware and infrastructure stack • Strong quantitative reasoning skills and ability to work from first principles using FLOPs, bytes, bandwidth, latency, joules, watts, and dollars • Ability to build structured models connecting hardware design, workload performance, infrastructure requirements, and economic outcomes • Working knowledge of AI workload demands on memory bandwidth, memory capacity, interconnect communication, collective operations, and real-world compute utilization • Working understanding of semiconductor manufacturing and economics, including process-node trade-offs, die size, yield, die cost, packaging, and HBM integration • Ability to explain architecture decisions and their effects on manufacturing cost, performance, power, and scalability • Strong written communication skills for engineering and investor audiences • Ability to take ambiguous technical questions from definition through analysis, validation, and publication with minimal oversight • Self-driven, intellectually rigorous, detail-oriented, and comfortable challenging assumptions • Genuine enthusiasm for computer hardware, semiconductor technology, AI systems, and infrastructure research • Hands-on experience with AI training or inference frameworks such as vLLM, SGLang, TensorRT-LLM, PyTorch, or JAX (preferred) • Experience with GPU programming or kernel development using CUDA, Triton, or HIP (preferred) • Understanding of transformer inference mathematics, including per-token FLOPs, memory traffic, KV cache sizing, MoE routing, and quantization effects (preferred) • Experience designing, deploying, benchmarking, or operating large GPU or accelerator clusters (preferred) • Knowledge of datacenter networking, rack-scale architecture, power distribution, cooling, or large AI infrastructure deployments (preferred) • Familiarity with training performance metrics, parallelism scaling efficiency, communication overhead, and failure recovery (preferred) • Experience benchmarking heterogeneous hardware (preferred) • Hands-on semiconductor process, foundry, product engineering, yield, packaging, or test experience (preferred) • Experience with die cost modeling, semiconductor manufacturing economics, advanced packaging, or teardown analysis (preferred) • Ability to interpret die shots, packaging layouts, physical specifications, and teardown data (preferred) • Prior technical publications, research papers, open-source contributions, benchmarks, hardware teardowns, or industry analysis (preferred) • Experience communicating technical findings to clients, executives, engineers, or institutional investors (preferred) • SemiAnalysis LLC participates in E-Verify to confirm employment eligibility of all newly hired employees
• Remote work arrangement • In-office/Remote work setting • Opportunity to work with a global team of 50+ analysts • Opportunities to expand expertise across the complete AI hardware stack • Opportunities to develop technical writing and publishing skills • Opportunities to become a recognized technical authority • Opportunities to lead client briefings • Opportunities to define and own a research coverage area • Opportunity to contribute to SemiAnalysis models, simulators, datasets, and research methodologies
Apply NowImprove your chances of getting an interview by checking your resume score before you apply.
🔥 28 minutes ago
Member of Technical Staff shaping and shipping customer-specific changes for Clara’s healthcare platform. Supporting implementations, EHR integrations, and product improvement remotely across the US.
🔥 46 minutes ago
Engineering Director leading development of Parento’s paid parental-leave insurance platforms. Managing engineering while building portals, integrations, and scalable internal tools.
🕒 3 days ago
Senior Azure engineer building C#/.NET applications and healthcare data pipelines for Ovation Healthcare's Revenue Cycle Management operations. Modernizing legacy systems into secure, HIPAA-compliant cloud solutions.
🕒 3 days ago
Mobile Engineer building iOS and Android apps for OpenClaw’s open-source AI agent platform. Delivering secure, real-time mobile experiences for interacting with personal AI agents.
🕒 3 days ago
Databricks Developer building and testing AWS data solutions for Diaconia’s government programs. Prototyping, debugging, reviewing code, and leading engineering initiatives.