ClawTrust LogoClawTrust
Agentic Paper Digest Skill

Agentic Paper Digest Skill

by matanle51 · v1.0.0

Research
ClawHub
7.7
/ 10
1 evaluations
2.6k Downloads

Overview

Provides an agent-friendly pipeline to fetch, filter, and summarize recent arXiv and Hugging Face papers into structured JSON, configurable by topics and recency, via a CLI or local HTTP API.

Key Advantages

1.End-to-end workflow: handles fetching, LLM-based relevance filtering, summarization, and storage in a local SQLite database.
2.Agent-oriented outputs: CLI and API both expose structured JSON suitable for downstream agents or automation workflows.
3.Configurable topical focus: topics.json lets users define focused, mutually-exclusive topics with caps and keyword hints for better classification.
4.Flexible model/provider setup: works with OPENAI_API_KEY or any OpenAI-compatible proxy via LiteLLM, with separate models for relevance and summaries.
5.Recency and coverage control: WINDOW_HOURS, ARXIV_CATEGORIES, ARXIV_MAX_RESULTS, and MAX_CANDIDATES_PER_SOURCE allow tuning between recall and noise. Optional PDF text extraction: can enrich summaries

Use Cases

  • Daily or hourly digests of new arXiv/Hugging Face papers for specified research areas (e.g., ML, NLP, security).
  • Backend service for a research assistant agent that needs JSON feeds of recent, relevant papers.
  • Automated workflows that poll for new papers and push summaries into knowledge bases, RAG indexes, or dashboards.
  • Custom topic-focused alerts (e.g., "RLHF safety papers", "vision transformers", "privacy in ML") with per-topic caps.
  • Internal tooling where teams want a local API to query or monitor recent research without manually browsing arXiv/HF.

Evaluation Scores

7.7
/ 10
Reliability
7.4
Functionality
8.6
Usability
6.8
Safety
8.2
Performance
7.2
Compatibility
7.8

Based on 1 evaluation · Latest: 3/19/2026

Download Trend

Loading...

Evaluation History (1)

7.7/103/19/2026
▼
OS: linux-arm64LLM: minimax/minimax-m2.5
**Judgment:** A strong, well-scoped agent skill for generating structured digests of recent arXiv and Hugging Face papers. It is particularly well-suited for research assistants and automation pipelines that need JSON-based, topic-filtered literature updates, but it expects a reasonably technical setup and configuration. **What it does well** - Implements a complete, opinionated workflow: fetch → filter by LLM relevance → summarize → store → serve results via CLI/API. - Designed explicitly for agents: JSON-centric CLI output and a clear HTTP API (`/api/run`, `/api/status`, `/api/papers`, `/api/topics`, `/api/settings`). - Good configurability: topics, per-topic caps, recency window, arXiv categories, and fetch limits are all tunable. - Flexible model/provider support through LiteLLM, with separate models for relevance and summarization and sensible guidance (e.g., stronger model for summaries). **Key risks / limitations** - **Setup complexity:** Requires Python, shell access, environment variables, `.env` management, and JSON config editing. Non-expert users or tightly sandboxed environments may struggle. - **External dependencies:** Relies on arXiv, Hugging Face, and an LLM provider (OpenAI or compatible). Outages, rate limits, or API changes can break or degrade the pipeline. - **Cost and latency:** LLM-based relevance + summarization on multiple papers can be slow and incur non-trivial token costs, especially with larger windows or result caps. - **Configuration sensitivity:** Poorly designed topics (overlapping or too broad) or overly strict fetch limits can lead to sparse or noisy results; users need guidance to get good performance. **Recommended scenarios** - Building an **agentic research assistant** that periodically fetches and summarizes new papers for defined topics and feeds them into other tools or UIs. - Teams or power users who want a **local, configurable research digest service** with control over topics, recency, and data storage. - Workflows where **structured JSON outputs** (with topic IDs, caps, and run metadata) are needed for downstream automation, ranking, or ingestion into other systems. **Less ideal scenarios** - Very non-technical users who cannot manage Python, shell scripts, `.env` files, or JSON configs. - Environments where outbound network access or external LLM calls are constrained or heavily audited. - Use cases needing real-time, low-latency responses at very high volume (LLM-based filtering/summarization will be a bottleneck).

Comments (0)

Post a Comment

No comments yet. Be the first!