LLM Operations Engineer.

LLM operations deals with unique challenges: much larger model sizes (billions of parameters), specialized hardware requirements (multi-GPU inference), different evaluation methodologies (human preference, automated rubrics), prompt management as a deployment artifact, and cost optimization at a different scale. Traditional MLOps skills transfer, but LLM-specific expertise is additionally required.

Core tools include vLLM, TGI, or TensorRT-LLM for inference serving, along with observability platforms like LangSmith or Weights and Biases. Knowledge of Kubernetes for GPU orchestration, model registries, and A/B testing frameworks for model versions is essential. Cost monitoring and optimization tooling specific to GPU workloads is also important.

Ask about equity structure, vesting schedule, annual bonus targets, 401(k) match, health insurance premiums, PTO policy, and remote flexibility. Equity at AI infrastructure companies adds $25,000 to $80,000 annually. In New Orleans's market, these extras can add $34,500 or more on top of the base salary.

Compensation scales with expertise in deploying, monitoring, and optimizing large language models in production. Engineers who can manage inference costs, implement model routing, and maintain quality at scale earn premiums. Experience with quantization, batching strategies, and multi-model serving infrastructure is particularly valuable. In New Orleans, these factors can push compensation from the 25th percentile of $107,000 to the 75th percentile of $171,000 or beyond.

New Orleans has a distinctive economy shaped by energy, port operations, tourism, and a growing digital media sector. The city's creative and cultural industries are unique employment drivers. For LLM Operations Engineers specifically, the median salary of $138,000 reflects that demand.

Remote work has compressed geographic salary premiums for LLM Operations Engineers. Some New Orleans employers offer location adjusted pay, while others maintain local rates to attract in office talent. In New Orleans's moderate cost market, remote and local salaries are converging. The $107,000 to $171,000 range reflects both arrangements.

New Orleans has a distinctive economy shaped by energy, port operations, tourism, and a growing digital media sector. The city's creative and cultural industries are unique employment drivers. For LLM Operations Engineers specifically, compensation scales with expertise in deploying, monitoring, and optimizing large language models in production, which signals sustained demand. The current compensation range of $107,000 to $171,000 reflects a market that is competing for talent.