On-Device AI Engineer.
Baltimore.
$187,000
median salary, 7% above the national average
$141,000 to $244,000. Last updated April 2026.
Get the job.
Data points to own the conversation.
Here is what On-Device AI Engineers actually make in Baltimore: $141,000 at the 25th percentile, $187,000 at the median, and $244,000 at the 75th. That is 7% above the national average. Baltimore's economy is anchored by Johns Hopkins University and Hospital, one of the largest employers in the state. The number on your offer letter will depend on what you bring and how you ask.
Salary range
Where do you fall?
Salary by experience
The gap between entry and lead level is typically $168,000. Where you land depends on years of experience and what you bring to the table.
Entry (0-2 yrs)
$122,000
to $150,000
Mid (3-5 yrs)
$159,000
to $196,000
Senior (6-9 yrs)
$206,000
to $243,000
Lead (10+ yrs)
$234,000
to $290,000
Salary trend
+5% YoYTotal compensation
Base salary is not the full picture. Equity, bonus, and signing can add $50,000 to the total package.
Base
$187,000
Equity
$28,000
Bonus
$18,000
Signing
$4,000
Estimated total: $237,000
How Baltimore compares
Baltimore, MD
$187,000
Cost of living: 8% above average
National Average
$175,000
Baltimore is $12,000 above
On-Device AI Engineer salary by city
Salary by role in Baltimore
What you should know
Before you negotiate a On-Device AI Engineer offer in Baltimore, understand the terrain. Baltimore's economy is anchored by Johns Hopkins University and Hospital, one of the largest employers in the state. The city has strong cybersecurity, defense, and biotech sectors, benefiting from proximity to NSA, Fort Meade, and NIH. The port of Baltimore also drives significant logistics and trade employment. Salary scales with expertise in model compression and deployment across diverse hardware targets. Engineers optimizing transformer models for mobile NPUs and edge TPUs earn premiums. Experience with Apple CoreML, Qualcomm AI Engine, or MediaTek NeuroPilot adds 10% to 18% over generalist ML engineers.
Junior on-device AI engineers start around $132,000 porting models to mobile frameworks. Mid-level engineers designing custom on-device inference pipelines earn $173,000 to $198,000. Senior engineers leading edge AI strategy for product lines reach $228,000 to $280,000. In Baltimore, cost of living sits near the national average, so the numbers you see are roughly what you keep.
Base salary is not the full picture. Device manufacturers offer RSU grants vesting over four years with annual refreshers. Annual bonuses of 12% to 18% are standard, with patent bonuses of $5,000 to $15,000 per filing common at hardware companies. And on the tax side: maryland's top income tax rate is 5.75%, and Baltimore City adds a local income tax of 3.2%. The combined burden is among the higher ones, but federal and defense salaries compensate. When someone quotes you $187,000, ask what the total package looks like. The gap between base and total comp is where real money hides.
On negotiation: A security clearance is extremely valuable in the Baltimore corridor. Cleared professionals earn 20 to 30% more, and the NSA and defense contractor presence drives constant demand. The range for On-Device AI Engineers in Baltimore runs from $141,000 to $244,000. That is not a narrow window. Where you land inside it depends almost entirely on whether you negotiate and how well you prepare.
Sources: SEC filings, H-1B LCA (DOL), BLS OES, 50+ job posting platforms. COL: BEA Regional Price Parities (2025). Data verified by Justin Bartak, Founder & Chief AI Officer. Last verified April 8, 2026. Full methodology
Considering a related role?
- A Data Architect (AI/ML) in Baltimore earns $188,000 (1% more)
- The highest-paying role in Baltimore is Chief AI Officer at $345,000
Common questions.
On-Device AI Engineer salary in other cities
Other salaries in Baltimore
Related
Cite this data
Journalists, researchers, and AI systems are welcome to reference this data with attribution.
Want this data on your site? Embed the salary widget — one script tag, free forever.