Hybrid job

Hybrid

Software Engineer AI Inference

Scaleway

Paris · Check country restrictionsPublished on Jul 24, 2026Confirmed active on Nov 22, 2026
Full-timeTechnology1-50

Job briefing

Read from the posting and checked against our job index

Office in
Paris
Work model
Hybrid, partly on site
Salary
Not stated

Good to know

Listed with us since
November 16, 2026
Employer
21 more open roles at Scaleway in our index. Of these, 1 fully remote.

Generated automatically by nomado24 from the posting and our index. Not an employer statement. The original posting is authoritative.

Job description

OUR STORY:

Join Scaleway and shape the sovereign cloud of tomorrow !
Since 1999, we have been designing secure, sustainable infrastructures aimed at supporting the most ambitious companies.

Historically known for our dedicated servers (Dedibox), we made a strategic shift to cloud computing in 2015. Staying true to our principles of simplicity, flexibility, and technical excellence, we have become one of the leading players in Europe in the sector.

With the rise of artificial intelligence, we have strengthened our commitment, supported by the Iliad Group, which is investing €3 billion to develop a serious, sovereign AI alternative to American and Asian giants.

Every day, thanks to our fast-growing portfolio of cloud and AI products (bare metal, containerization, serverless, AI, etc.), Scaleway proudly serves thousands of customer across the private and public sector, from corporations like France Télévisions or Hachette Livre, to fast-growing startups like Photoroom and Biolevate, to institutions like the City of Copenhagen.

Our offices are located in Paris, Lille, Toulouse, Rennes, Rouen, Bordeaux and Lyon.

WHY WE NEED YOU?
As Scaleway expands its AI capabilities, we are strengthening our AI Inference team to build and scale our next-generation inference platform.
Your mission will be to design, build, and operate high-performance AI inference infrastructure, enabling the deployment of LLMs and generative AI workloads at scale.
You will tackle challenges in distributed systems, GPU infrastructure, and performance optimization, helping shape the future of sovereign AI cloud infrastructure in Europe.

YOUR FUTURE TEAM
We work in a collaborative and international environment where the diversity of Scalers, combined with a spirit of sharing, helps bring new projects to life every day, advancing our ambitions together.
You will be part of a team of 4 DevOps engineers, working closely on backend and infrastructure topics related to AI inference. The squad  is part of a broader AI tribe focused on four strategic products:
Managed Inference, a platform to deploy, scale, and monitor AI models in production
Generative APIs, a unified API layer to access cutting-edge generative models (LLMs, Diffusion, etc.)
AI HPC, serving massive clusters, with thousands of GPU, to high end customers with strong model training needs
AI Tooling, developing in house technologies to boost Scaleway and the Iliad Group in their daily tasks

YOUR DAILY ROUTINE INCLUDES:
Build and operate infrastructure for serving LLMs and other generative models at scale
Design, deploy, and maintain Kubernetes-based services optimized for AI inference
Develop in Golang to build robust and efficient backend services
Optimize serving stacks using tools like vLLM, Triton, and CUDA
Integrate open-source AI tooling such as Hugging Face, KServe, or custom components
Participate in architecture discussions and make high-impact technical decisions
Keep up with the fast-paced evolution of AI serving ecosystems
Troubleshoot and resolve complex infrastructure and deployment issues
Collaborate with internal teams to integrate new AI features
Contribute to code reviews and knowledge sharing within the team

ABOUT YOU:
HARDSKILLS
Senior / Tech Lead profile with extensive experience in Software Engineering, complex systems architecture.
Strong experience with Golang in production environments
Proficiency with Kubernetes and container orchestration tools
Knowledge about AI models (LLMs, Diffusion models, …)
Hands-on experience with deploying and scaling ML models is appreciated
Solid understanding of backend architectures and DevOps practices

SOFTSKILLS
Fast learner with high adaptability to new technologies
Strong curiosity and willingness to dive deep into emerging AI tools
Proactive mindset and readiness to take initiative
Technical autonomy and ownership of your scope
Clear communicator, capable of explaining complex systems simply

WHAT YOU WILL FIND AT SCALEWAY ?
Hybrid work: Up to 3 days remote per week
Modern offices: Creative, ergonomic workspaces in prime locations with terraces and bike facilities
Healthy dining: Chef-prepared meals at HQ; Swile card for regional sites
Well-being: Support for gym memberships, childcare, and caregiver services
Diverse culture: English is as common as French; teams span many nationalities
Growth mindset: Strong internal mobility and opportunities across the Iliad Group

Why join the Scaleway adventure ?
A rich and diverse product offering: Scaleway offers over 100 public cloud products in IaaS, PaaS, AI.
A cutting-edge technical environment: Scaleway provides modern infrastructures, including high-performance bare metal servers, to tackle exciting technical challenges.
Commitment to responsible cloud: Scaleway is dedicated to a more responsible cloud, with data centers powered solely by renewable energy since 2017, minimizing our ecological footprint and holding top-level …

leverEngineeringFull time (long term)

This role is provided by an external source. Applications are handled on the source website.

New remote jobs like “AI Inference” by email

Free, and only when something fitting appears.

Confirm by email. Unsubscribe anytime. Privacy Policy.

All Remote Developer Jobs

Matching job categories

Not the right job?

Matches for your profile: two are free, with Nomado24 Pro you see up to 24. See Pro