Integrated all 5 upstream commits with custom modifications preserved: 1. Empty generator fix (750d9d9) - Refactored infer() to generator pattern - Created wrapper infer() that delegates to infer_generator() - Renamed monolithic method to infer_generator() - Changed final returns to yield for generator compatibility - Handles both streaming and non-streaming modes 2. Streaming implementation (b0c6ab8) - Added low-latency streaming - Added stream_return parameter for generator mode - Added more_segment_before parameter for streaming segmentation - Integrated with generator-based inference 3. UNK token warnings (34be9bf) - Token validation and user feedback - Detects unknown tokens in BPE model - Warns users with token IDs and suggestions 4. S2Mel optimization (31e7e85) - Mel-spectrogram generation speedup - Optimized fused_add_tanh_sigmoid_multiply() with torch.split - Fixed sequence_mask() with max_length parameter - Added enable_torch_compile() to CFM and MyModel classes - Added use_torch_compile parameter to infer_v2.py 5. GPT2 acceleration (c1ef414) - KV-cache and FlashAttention optimization - Created new /accel/ module with 5 files (609-2500 lines) - Added use_accel parameter to UnifiedVoice - Integrated AccelInferenceEngine for 1.5-3x speedup - Optional feature (requires flash-attn library) Custom modifications preserved: - QwenEmotion lazy loading with path fallbacks - W2V-BERT loading from TTS folder (unified downloader integration) - All custom logging and error handling - Custom emotion vector processing Generated upstream tracking documentation in docs/Upstream_Engine_Tracking/
104 lines
2.0 KiB
Markdown
104 lines
2.0 KiB
Markdown
# [ENGINE_NAME] Upstream Update Log
|
|
|
|
**Engine:** [ENGINE_NAME]
|
|
**Official Repository:** [UPSTREAM_URL]
|
|
**Bundled Location:** `engines/[engine_folder]/`
|
|
**Last Checked:** YYYY-MM-DD
|
|
**Last Checked By:** [username]
|
|
|
|
---
|
|
|
|
## Check History
|
|
|
|
| Date | Commits Checked | New Features | Bug Fixes | Breaking Changes | Notes |
|
|
|------|-----------------|--------------|-----------|------------------|-------|
|
|
| YYYY-MM-DD | N/A | - | - | - | Initial setup |
|
|
|
|
---
|
|
|
|
## Latest Upstream Changes (Since Last Check)
|
|
|
|
### New Features 🆕
|
|
- Feature 1
|
|
- Feature 2
|
|
|
|
### Bug Fixes 🐛
|
|
- Fix 1
|
|
- Fix 2
|
|
|
|
### Breaking Changes ⚠️
|
|
- Change 1
|
|
- Change 2
|
|
|
|
### Performance Improvements ⚡
|
|
- Improvement 1
|
|
|
|
### Documentation Updates 📝
|
|
- Update 1
|
|
|
|
---
|
|
|
|
## Integration Status
|
|
|
|
| Item | Status | Priority | Notes |
|
|
|------|--------|----------|-------|
|
|
| Feature/Fix name | `pending`/`integrated`/`skipped` | 🔴/🟡/🟢 | Integration notes |
|
|
|
|
### Legend
|
|
- `pending` - Identified but not yet integrated
|
|
- `integrated` - Applied to bundled code
|
|
- `skipped` - Reviewed but decided not to integrate
|
|
- `wontfix` - Not applicable to our implementation
|
|
|
|
---
|
|
|
|
## Integration Notes
|
|
|
|
### Conflicts with Our Customizations
|
|
- [List any conflicts between upstream changes and our custom modifications]
|
|
|
|
### Testing Required
|
|
- [ ] Test case 1
|
|
- [ ] Test case 2
|
|
|
|
### Version Bump Recommendation
|
|
- Current bundled version: X.Y.Z
|
|
- Latest upstream version: X.Y.Z
|
|
- Recommended bump: `patch` / `minor` / `major` / `none`
|
|
|
|
---
|
|
|
|
## Known Customizations We Maintain
|
|
|
|
List any intentional differences from upstream:
|
|
- Customization 1
|
|
- Customization 2
|
|
|
|
---
|
|
|
|
## Next Check
|
|
|
|
**Scheduled for:** YYYY-MM-DD
|
|
**Check interval:** Weekly / Bi-weekly / Monthly
|
|
|
|
---
|
|
|
|
## Previous Check Summary
|
|
|
|
Link to previous check details if available.
|
|
|
|
---
|
|
|
|
## Quick Commands
|
|
|
|
```bash
|
|
# Clone/update upstream repository
|
|
git clone [UPSTREAM_URL] /tmp/[engine_name]_upstream
|
|
|
|
# Compare with our bundled version
|
|
diff -r /tmp/[engine_name]_upstream/[source_folder] engines/[bundled_folder]/
|
|
|
|
# Show recent commits from upstream
|
|
git log --oneline -20 origin/main
|
|
```
|