AI Engineering - Richard

AI Engineering - Richard

icon
Project’s dates
  • Start Date - 08/04/2025
  • Estimated End Date - 27/06/2025
  • Actual End Date - [Actual End Date]
icon
Medical Report Generation from Image Analysis Outputs

Problem Many image analysis algorithms and tools are used daily in the radiology workflow, while AI seems to be most promising for image analysis. AI Applications usually produce outputs in PDF, DICOM format, or a combination, as classification and segmentation are common tasks in medical image analysis. The additional images are stored and reviewed in the PACS, leading to an increased workload for radiologists when creating the medical report for referring physicians.

Solution

Support Radiologists by organizing multiple image analysis applications: Use the Image Analysis - Output (e.g. vertebral lesion detection) to generate a professional text section that describes and summarizes the findings for use in the medical report, following the RSNA Guidelines. 1. Anonymization 2. Preprocessing 3. OpenAI API generates structured output The intended use is in the medical reporting workflow, to help organize image analysis AI applications.

MVP-Workflow:

β€£
Typical Radiology-Workflow and report structure (RSNA-conform)
β€£
Example-Image of an AI Analysis Output (https://www.nucs.ai/products/deep-psma)
β€£
AI generated report section (RSNA conform)
β€£
Routes

Project Folder Structure

β€£
medimage2report/

Features:

  • Add optional section that describes β€œTechniques”-part
  • German and English languages available for report text
  • Offer multiple styles

References:

Structured Reporting:

Organization
Link
RSNA (no more updated)
RSNA / American College of Radiology
Germany
icon
Github repo

[Enter github repo link]

icon
Database Schema

PROJECT: Generate Medical Report Text from Image Analysis - PDF

image
icon
Comparison Table

[Update the comparison table]

Comparison TableComparison Table
icon
Project Video Recording

[3-5 minutes video recording of your project]

icon
Project Slides

[3-5 slides presenting your project]

Unnamed
icon
[Optional] Screenshots

[Enter screenshots of your project]

icon
Main Topics of Learning Materials
  • Fundamentals of AI, Machine Learning, LLM’s
    • Evolution of AI - History of Machine Learning
    • What changed with LLM’s - ChatGPT Revolution
    • Current market leads and differences between them
  • Natural Language Processing
    • Data Preprocessing
    • Data Cleaning
  • API Integration with AI models
    • Structured Output
  • Prompt Engineering
  • GenAI Ethics
  • Advanced GenAI
    • Retrieval Augmented Generation (RAG)
icon
External Optional Resources
Video ResourcesWritten Resources
icon
Examples of projects
β€£
AI Data Analyst
β€£
Ask me anything about a big project
β€£
Online Service - Article AI assistant
β€£
A tool that uses AI to automatically label large datasets
β€£
Image Generation for Ads
Student Project

RagLangBot Project Overview

icon
Examples of bad projects
β€£
What should I make for dinner?
β€£
Text Auto-completion Tool
β€£
Random Image Generator

V1 Milestones

Milestone
Description
Achieved
BA_1
πŸ…
DB_1
AI_1

[Add Milestones according to your project needs]

V2 Milestones

Milestone
Description
Achieved
BA_X
πŸ…
DB_X
AI_X

[Add Milestones according to your project needs]

icon
Progress tracking timeline
β€£
Week 1 - Project idea definition
β€£
Week 2-3 - Backend & Database setup
β€£
Week 4 - First GenAI request
β€£
Week 5-8 - GenAI iterations
β€£
Week 9-10 - [opt] RAG & Extras
β€£
Week 11-12 - Finalizing project & Presentation