Commit Graph

3 Commits

Author SHA1 Message Date
kbanc85 b40925054e Change GitHub Actions schedule from 6-hour to 24-hour intervals
Reduced the frequency of newsletter checks from every 6 hours to once every 24 hours (daily at midnight UTC).

Changes:
- Cron schedule: '0 */6 * * *' → '0 0 * * *'
- Now runs once daily at midnight UTC instead of 4 times per day

Rationale:
- Reduces GitHub Actions usage/costs
- Newsletter posts are typically published once every few days, not hourly
- Daily checks are sufficient for timely content updates
- Manual trigger (workflow_dispatch) still available for immediate updates

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-09 16:28:32 -05:00
kbanc85 9956c9dee4 Improve extraction scripts, validation, and documentation
Enhance article extraction and validation systems with better error handling, retry logic, and content cleaning.

Script improvements:
- Add retry logic with exponential backoff for API calls
- Implement 60-second timeout for Anthropic API requests
- Improve HTML cleaning with Substack-specific filters
- Remove navigation, footer, and UI noise from extracted content
- Better HTML entity decoding

Validation enhancements:
- Add duplicate URL detection across articles
- Validate topic assignments against known topics
- Enhanced error reporting with specific issue types

GitHub Actions:
- Add build output validation step
- Verify /out directory exists before PR creation
- Count generated HTML files for sanity check

Documentation updates:
- Update project stats (26 articles, ~30 pages)
- Document v1.2 improvements
- Add changelog entries

Type safety:
- Improve topics.ts type definitions

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-09 14:06:19 -05:00
kbanc85 b1ef96c48b Add automated article processing system
🤖 Automated workflow that:
- Monitors aiadopters.club RSS feed every 6 hours
- Extracts claim data using Claude AI
- Creates PRs for review before going live

Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-05 21:31:07 -05:00