Skip to content

llm-output-quality-monitor MCP server

io.github.lazymac2x/llm-output-quality-monitorlazymac2xstreamable-httpv1.0.0Scanned

Cloudflare Workers MCP server: llm-output-quality-monitor

5 tools: 3 change things and 2 only read.

Tools: 0 delete, 0 irreversible, 3 write, 2 read.
  • Reads private data · 0
  • Reads text others write · 0
  • Can send data out · 0
  • No findings

Tools listed without sign-in. Remote posture

Anlyon alternative

3 of these tools change something. Run those as governed actions.

Declare what an action changes, and Anlyon puts it under a shared limit, binds every approval to the exact request, and grades the outcome. It works on any HTTPS API you can describe as an action.

Anlyon Radar does not run, proxy or govern this MCP server. A tool your own code calls directly is not routed through Anlyon and is not governed by it.

Import an OpenAPI spec →

What the llm-output-quality-monitor MCP server can do

The llm-output-quality-monitor MCP server is published by the GitHub account lazymac2x. It has 5 tools. It can create or change data (3 tools: drift_detector, hallucination_scorer and consistency_check), but cannot delete data. 2 tools only read.

None of its tools reads private data, brings in text other people write, or sends data out.

None of the fixed checks matched anything in its tool definitions. That is not a safety guarantee.

Its remote endpoint lists its tools without sign-in.

Last scanned Nov 21, 2026, version 1.0.0.

Tools

Grouped by what each tool does, most consequential first. Open one for its reasons and full description; descriptions are the publisher's own words.

5 tools

Changes things 3Claude Code: ask
  • consistency_checkCheck consistency across multiple LLM responsesNo findings

    Why it is in this group

    • Nothing in its name or description says what it does, so it is counted as a write.
    Description, as the server wrote it
    Check consistency across multiple LLM responses
  • drift_detectorDetect quality drift between current and previous LLM responsesNo findings

    Why it is in this group

    • Nothing in its name or description says what it does, so it is counted as a write.
    Description, as the server wrote it
    Detect quality drift between current and previous LLM responses
  • hallucination_scorerPattern-based heuristic risk scoring for LLM responses (0-100).No findings

    Why it is in this group

    • Nothing in its name or description says what it does, so it is counted as a write.
    Description, as the server wrote it
    Pattern-based heuristic risk scoring for LLM responses (0-100). Detects linguistic signals such as contradictory assertions, unsourced claims, and uncertainty markers. Not a semantic hallucination detector.
Only reads 2Show 2 read-only tools
  • quality_validatorValidate LLM response quality based on length, format, and structureNo findings

    Why it is in this group

    • The description's first verb is "validate": a word for reading.
    Description, as the server wrote it
    Validate LLM response quality based on length, format, and structure
  • schema_enforcerValidate JSON response against schemaNo findings

    Why it is in this group

    • The description's first verb is "validate": a word for reading.
    Description, as the server wrote it
    Validate JSON response against schema

This is not a safety rating, and no finding is not a safety guarantee. The groups and findings come from fixed checks of the tool definitions the server returned on the date shown, not from its code or what it does when called. How the checks work.

Exfil surface

Which tools read private data, which read text someone else can write, and which can send data out. One of each is a path a prompt injection can use.

No private-data, untrusted-input, outbound path in this server alone: no tool is tagged private-data or untrusted-input or outbound.

Reads private data0
Reads files, mail, messages, databases, secrets, calendars or repositories.
Reads text others write0
Brings in text someone else can write: web pages, inbound email, messages, issues and comments.
Can send data out0
Can carry data to people or systems: it sends, posts or publishes, or takes a recipient, channel or URL.

Other servers in the same agent add their own tools to these paths. Audit your whole setup to see them together.

Remote posture

What anyone on the internet sees at the remote endpoint: an anonymous initialize and tools/list, and the public OAuth metadata.

Tools listed without sign-in

Looked at Nov 20, 2026, 19:32 UTC, unchanged since Oct 22, 2026. No credentials were sent and no tool was called. What is looked at.

Reachable
yes
HTTP status of an anonymous initialize
200
tools/list served without credentials
yes
Tools that change things, listed without credentials
3
Protocol version
2024-11-05
WWW-Authenticate on 401
not observed
resource_metadata in WWW-Authenticate
not observed
RFC 9728 protected resource metadata
https://api.lazy-mac.com/.well-known/oauth-protected-resource/llm-output-quality-monitor/mcp
Authorization servers
not observed
Legacy HTTP+SSE transport
no
Dynamic client registration
not observed
Client ID metadata documents
not observed
  • WarnThe whole server

    The endpoint served tools/list without credentials, and the list has 3 tools that change things (3 write). Whether a call also works without credentials was not tested: tools are never called.

    Matched text

    https://api.lazy-mac.com/llm-output-quality-monitor/mcp: tools/list returned 5 tools to an anonymous client, including drift_detector (write), hallucination_scorer (write), consistency_check (write)

    What this check looks for

Findings

Matches of fixed checks, with the text they matched.

No check matched anything in these tool definitions. That is not a safety guarantee.

History

Changes to its tool definitions and to its remote endpoint, newest first.

No change seen yet. Its tools are rescanned every day, and a remote endpoint is looked at once a week.

Install

Pinned to version 1.0.0. Values in angle brackets are yours to fill in.

claude mcp add --transport http llm-output-quality-monitor https://api.lazy-mac.com/llm-output-quality-monitor/mcp
claude mcp add --transport http llm-output-quality-monitor https://api.lazy-mac.com/llm-output-quality-monitor/mcp

Run in a terminal.

Claude Code permissions

Allow the reads, ask before a change or a way out, deny the deletes. Paste into .claude/settings.json.

.claude/settings.json
{
  "permissions": {
    "allow": [
      "mcp__llm-output-quality-monitor__quality_validator",
      "mcp__llm-output-quality-monitor__schema_enforcer"
    ],
    "ask": [
      "mcp__llm-output-quality-monitor__drift_detector",
      "mcp__llm-output-quality-monitor__hallucination_scorer",
      "mcp__llm-output-quality-monitor__consistency_check"
    ],
    "deny": []
  }
}

Tools that only read are allowed, tools that change things ask first, tools that delete or cancel are denied. A read that can send data out (it takes a URL, say) asks first too. It assumes the server is installed as llm-output-quality-monitor. Review it before you use it.

Pin

Keep the decision: fail CI when the tools change, follow every change, or show a badge.

Pin in CI

Fail a build when the tools you reviewed are not the tools the server serves today.

curl -s "https://radar.anlyon.com/api/v1/servers/io.github.lazymac2x/llm-output-quality-monitor/verify?hash=b948c4dc983c2abda49aaf564539534a32b660a11339a7a71481217b150d08b0" | jq -e '.changed == false'

Pinned hash b948c4dc983c, from Nov 21, 2026, 18:17 UTC.

Watch

Get told when its tools change: a new tool, a new description, a new class.

https://radar.anlyon.com/servers/io.github.lazymac2x/llm-output-quality-monitor/changes.xml

An Atom feed. Works in any feed reader or Slack's RSS app.

Badge

Anlyon Radar badge for io.github.lazymac2x/llm-output-quality-monitor
[![Anlyon Radar](https://radar.anlyon.com/badge/io.github.lazymac2x/llm-output-quality-monitor.svg)](https://radar.anlyon.com/servers/io.github.lazymac2x/llm-output-quality-monitor)

Source: MCP Registry · repository. Synced Oct 21, 2026, 18:38 UTC.

llm-output-quality-monitor MCP server: questions and answers

Answered from the scan above, not from the publisher's description.

Is the llm-output-quality-monitor MCP server safe?

No scan can promise that. What its definitions show: 5 tools, 3 of which can change, send or delete something, and 0 findings from fixed checks. Allow the reads, ask before each change, and deny the deletes; the permissions block on this page does that.

Can the llm-output-quality-monitor MCP server delete data?

No tool is classed as destructive: going by their definitions, none of them deletes, cancels or revokes anything.

Can the llm-output-quality-monitor MCP server do things that cannot be undone?

No tool is classed as irreversible: none of them sends, pays, publishes or merges, going by their definitions.

What tools does the llm-output-quality-monitor MCP server have?

5 tools: 3 write, 2 read. drift_detector, hallucination_scorer, consistency_check, quality_validator and schema_enforcer.

Does the llm-output-quality-monitor MCP server need sign-in or OAuth?

Its remote endpoint listed its tools to an anonymous client, without sign-in.

Does the llm-output-quality-monitor MCP server send data to outside services?

None of its tools sends, posts or publishes, or takes a recipient, channel or URL.

Has the llm-output-quality-monitor MCP server changed its tools?

Not since Anlyon Radar started tracking it. Last scanned Nov 21, 2026.