Skip to content

Senior AI Architect

  • Hybrid
    • Prague, Praha, Hlavní město, Czechia
  • €56 - €65 per hour
  • Jimmy Technologies

If you are passionate about GenAI architecture, and building production-grade LLM solutions, this role with our client offers a unique opportunity to shape AI in the German public sector!

Job description

We are seeking a highly experienced German-speaking Senior AI Architect for a long-term public-sector project in Germany. We're looking for an architect with a deep technical foundation in modern AI systems: someone who has led the architecture of multiple GenAI solutions and understands LLMs not just conceptually, but from the inside, including fine-tuning and productive deployment.

The environment is primarily on-premises / sovereign cloud, so experience designing AI systems outside of hyperscaler-native setups is key.

This is a long-term, full-time contract position, approx. 90% remote and 10% on site in Nuremberg.

Work Conditions

  • Start Date: ASAP

  • Location: ~90% remote, ~10% on site in Nuremberg

  • Workload: Full-time

  • Long-term contract based-role

Job requirements

  • Very good German and strong communication skills.

  • Lead architect experience on at least 2–3 GenAI projects, ideally in the public sector (not required).

  • In-depth knowledge of LLMs, RAG, GraphRAG, AI Gateways, and comparable architectures.

  • Deep understanding of modern AI model architecture and hands-on implementation experience, e.g. LLM fine-tuning or building productive GenAI solutions.

  • Experience with on-prem architectures or sovereign cloud environments.

  • Technical background, ideally a degree in computer science, machine learning, artificial intelligence, or data science.

  • Project management qualities are a strong plus.

Technical Requirements

Mandatory

  • Large Language Models: architecture, selection, evaluation, deployment

  • RAG and GraphRAG architectures

  • AI Gateways and LLM orchestration patterns

  • LLM fine-tuning and/or productive GenAI solution development

  • On-prem or sovereign cloud AI infrastructure

Nice to have

  • Public sector project experience (Germany / DACH)

  • AWS

  • Project management or technical delivery lead experience

  • Academic background in ML, AI, or data science

or