DEV Community

Cover image for AI-SLOP Detector v2.7.0 — Why We Built a Linter We Actually Use
Kwansub Yun
Kwansub Yun

Posted on

AI-SLOP Detector v2.7.0 — Why We Built a Linter We Actually Use

This Is What “Passing Lint” Looks Like

And yes — it can still be slop.

"""
Enterprise-grade data processing pipeline with fault-tolerant
error handling and production-ready scalability features.
"""
import torch
import numpy as np
from typing import Optional, Dict, List

def process_data(data: Optional[Dict[str, List[float]]]) -> Dict:
    """Production-ready scalable data processing."""
    if data is None:
        return {}
    return {k: v for k, v in data.items()}
Enter fullscreen mode Exit fullscreen mode

Zero lint errors.

But:

  • torch / numpy are never used
  • 13 lines of docstring for 3 lines of logic (4.3× inflation)
  • “enterprise-grade”, “production-ready” — no structural evidence
  • The function is a dictionary identity wrapped in confident language

Traditional linters check form.
This tool checks substance.


Why This Became Non-Optional

In complex systems — especially regulated or audit-sensitive ones — “code that looks correct” isn't just annoying.

It’s risky and expensive.

When AI becomes a primary production input,
the failure mode isn’t syntax.

It’s substance deficit:

  • unused architectural weight
  • decorative abstractions
  • evidence-free maturity claims

That’s the class of problem this tool targets.


What v2.7.0 Actually Fixes

Previously, the VS Code extension surfaced only a portion of what the CLI detected.

Now it surfaces ~95% of that analysis directly inside the editor.

The goal wasn’t new rules.
It was alignment.


What’s Now Visible in VS Code

1️⃣ Docstring Inflation (line-level)

Docstring inflation: process_data (13 doc / 3 impl = 4.3x)
Enter fullscreen mode Exit fullscreen mode

2️⃣ Evidence-Based Claim Validation

"production-ready" claim lacks evidence: tests, logging, error handling
Enter fullscreen mode Exit fullscreen mode

3️⃣ Hallucinated Dependencies

Hallucinated dependency: torch
Enter fullscreen mode Exit fullscreen mode

Imports that exist — but serve no verified purpose.


4️⃣ Pattern Suggestions

Warnings now include actionable fix guidance.


5️⃣ 1500ms Debounced Analysis

Lint-on-type runs after you pause typing —
not on every keystroke.


6️⃣ LDR (Logic Density Ratio) in Status Bar

LDR approximates the ratio of executable logic to structural scaffolding.

It’s not perfect.
But it’s a useful early signal.


Coverage Change

Diagnostic v2.6.3 v2.7.0
Pattern issues ✔️ ✔️ + suggestions
Docstring inflation ✔️
Evidence validation ✔️
Hallucinated deps ✔️
LDR status ✔️
Lint-on-type Immediate 1500ms debounce

Coverage: ~40% → ~95%.


If we stop using it, we’ll stop updating it.

This project isn’t driven by marketing cycles.

We don’t update it to announce something.
We update it because our own systems demand it.

If a new module exposes a failure mode, the detector evolves.

If it slows down our workflow, we fix it.

We ship what we use.
And if someday we stop using it, we’ll stop updating it.

Until then, it stays part of our gate.


Install

CLI

pip install ai-slop-detector
slop-detector myfile.py
Enter fullscreen mode Exit fullscreen mode

VS Code

ext install Flamehaven.vscode-slop-detector
Enter fullscreen mode Exit fullscreen mode

Marketplace:
https://marketplace.visualstudio.com/items?itemName=Flamehaven.vscode-slop-detector


GitHub logo flamehaven01 / AI-SLOP-Detector

Stop shipping AI slop. Detects empty functions, fake documentation, and inflated comments in AI-generated code. Production-ready.

AI-SLOP Detector Logo

AI-SLOP Detector v2.7.0

PyPI version Python 3.8+ License: MIT Tests Coverage

Production-grade static analyzer for detecting AI-generated code quality issues with evidence-based validation.

Detects six critical categories of AI-generated code problems with actionable, context-aware questions.


Quick Navigation: 🚀 Quick Start✨ What's New🏗️ Architecture📊 Core Features⚙️ Configuration🔧 CLI Usage🚦 CI/CD Integration👨‍💻 Development


Quick Start

# Install from PyPI
pip install ai-slop-detector

# Analyze a single file
slop-detector mycode.py

# Scan entire project
slop-detector --project ./src

# CI/CD Integration (Soft mode - PR comments only)
slop-detector --project ./src --ci-mode soft --ci-report

# CI/CD Integration (Hard mode - fail build on issues)
slop-detector --project ./src --ci-mode hard --ci-report

# Generate JSON report
slop-detector mycode.py --json --output report.json
Enter fullscreen mode Exit fullscreen mode

CLI Output Example


What's New in v2.7.0

VS Code Extension Upgrade

  • Docstring Inflation Diagnostics: Line-level detection of over-documented functions with severity mapping (critical/warning)
  • Evidence-Based Claim Validation: Flags unjustified jargon claims lacking…




Top comments (0)