cs-se/software-engineering IB-arxiv-2607.28307-o3-service-identification-f1 measured

Using OpenAI o3 to synthesize microservice architectures from textual requirements, service-identification F1 versus reference architectures was 0.79 under zero-shot prompting and 0.97 under few-shot prompting (two systems: Bookstore and PetClinic; one execution per condition).

Active Evidence state is recorded explicitly and may be revised by a later event.

Observed quantities

f1_zero_shot 0.79 · f1_few_shot 0.97 · num_systems 2 · runs_per_condition 1

01

Primary source

  1. arxiv · 2607.28307 · v1 · abstract
Title
From Textual Requirements to Microservice Architectures - A Comprehensive Evaluation of LLM-Based Design Synthesis
Authors
Danyllo Albuquerque, José Renan, Guillermo Rodríguez, Guillermo Rodríguez, Emanuel Dantas, Ademar França, Mirko Perkusich, Kyller Gorgônio, Angelo Perkusich
Version
v1
Check
Support quote found word for word in the arXiv abstract v1, 2026-10-08
Supporting quote from the source
OpenAI o3 identifies services with higher agreement under FS prompting (F1 = 0.79 for ZS versus = 0.97 for FS)

02

Boundary of this block

No additional public limitation was recorded.

03

Connections

Outgoing

No outgoing public edges.

Incoming

No incoming public edges.