Commit Graph

11 Commits

Author SHA1 Message Date
kbanc85 9956c9dee4 Improve extraction scripts, validation, and documentation
Enhance article extraction and validation systems with better error handling, retry logic, and content cleaning.

Script improvements:
- Add retry logic with exponential backoff for API calls
- Implement 60-second timeout for Anthropic API requests
- Improve HTML cleaning with Substack-specific filters
- Remove navigation, footer, and UI noise from extracted content
- Better HTML entity decoding

Validation enhancements:
- Add duplicate URL detection across articles
- Validate topic assignments against known topics
- Enhanced error reporting with specific issue types

GitHub Actions:
- Add build output validation step
- Verify /out directory exists before PR creation
- Count generated HTML files for sanity check

Documentation updates:
- Update project stats (26 articles, ~30 pages)
- Document v1.2 improvements
- Add changelog entries

Type safety:
- Improve topics.ts type definitions

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-09 14:06:19 -05:00
kbanc85 a35d861b3b Remove Office Hour entry and filter live broadcasts
- Remove "Office Hour ☕️✌️" entry (live video, not article)
- Update check-new-articles.ts to filter out:
  - Office Hour entries
  - Club Lounge entries
  - Live videos/broadcasts
  - Entries with ☕ or ✌ emojis
- Prevent future auto-import of similar content

Result: 24 articles (down from 25)

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-06 17:58:16 -05:00
kbanc85 edcf63d894 Clean up claims data and add validation system
- Remove 5 duplicate articles with invalid 404 URLs
- Fix 7 publication date mismatches (January → October 2025)
- Fix 68 token-length violations (12-18 token standard)
- Add missing fields: quotes, keyStatistics, claimTitles
- Implement automated validation system
- Add validation scripts and documentation

Result: 25 clean articles, 0 errors, 0 duplicates

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-06 17:54:07 -05:00
kbanc85 15d4775322 Implement two-tier AI extraction for 19% cost savings
Optimization strategy:
- Tier 1: Claude Haiku extracts metadata (slug, title, topics, keyPoints)
- Tier 2: Claude Sonnet extracts quality content (claims, quotes, context)

Benefits:
- 19% cost reduction per article (~$0.017 vs $0.021)
- 2-3x faster metadata extraction
- Each model optimized for its strength
- Maintains quality while reducing costs

Performance:
- Haiku: Fast, cheap, perfect for structured data
- Sonnet: High quality for nuanced analysis
- Combined: Best of both worlds

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-06 13:10:22 -05:00
kbanc85 f5c6953d73 Fix comma insertion logic to prevent undefined entries
Improvements:
- Check for existing trailing comma before adding separator
- Validate generated entry contains required fields
- Prevents duplicate commas when inserting multiple claims sequentially

This fixes the "Type 'undefined' is not assignable" error

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-06 11:46:32 -05:00
kbanc85 e3a7ced791 Fix TypeScript isolatedModules export error 2025-11-06 11:28:18 -05:00
kbanc85 63f28d45a7 Add defensive checks to RSS/sitemap generation
Prevents crashes when malformed claim entries exist:
- Skip undefined or incomplete claim objects
- Log warnings for debugging
- Allow build to continue despite data issues

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-06 11:16:57 -05:00
kbanc85 a81a78fbf5 Fix automation syntax errors and add infographics support
Critical fixes:
- Enhanced escaping function to handle special characters ($, `, ", etc.)
- Added infographics field support to extraction scripts
- Prevents build failures from malformed TypeScript generation

This fixes the "Expected } but found enablement" error that occurred
when processing the 15 new articles.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-06 09:13:21 -05:00
kbanc85 b1ef96c48b Add automated article processing system
🤖 Automated workflow that:
- Monitors aiadopters.club RSS feed every 6 hours
- Extracts claim data using Claude AI
- Creates PRs for review before going live

Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-05 21:31:07 -05:00
kbanc85 f40ada1aea Add 2 new claims pages using automated AI extraction
Added articles:
1. "Claude Skills cuts 8-hour tasks down to 1 hour"
   - Slug: claude-skills-productivity-boost
   - Date: 2025-10-21
   - 5 claims about Claude Skills productivity features
   - Stats: 8x speed improvement, 83% accuracy, 8MB limit

2. "The Internal Tools You Can Vibe Code and the Ones That Will Cost You Later"
   - Slug: vibe-coding-technical-expertise
   - Date: 2025-11-04
   - 5 claims about AI coding tradeoffs
   - Stats: $2,400 MRR, 95% code completion, $25 build cost

Workflow used:
✅ Visited aiadopters.club/archive
✅ Selected 2 random articles
✅ AI extracted all data (claims, titles, stats, quotes, context)
✅ Added to centralized claims.ts
✅ Built successfully (14 claims pages total)

Automated system works perfectly - no manual page files needed!

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-04 14:29:42 -05:00
kbanc85 834d71974c Automate sitemap and RSS feed generation
- Created scripts/generate-sitemap.ts to auto-generate sitemap.xml
- Created scripts/generate-rss.ts to auto-generate RSS feed
- Both scripts pull from centralized claims data
- Added prebuild script to run generators before each build
- Installed tsx for TypeScript script execution
- Sitemap and RSS feed now include all 11 claims pages (including ai-judgment-skills)
- Updated documentation with new auto-generated files
- No more manual updates needed for sitemap or RSS feed
2025-11-04 12:36:51 -05:00