โก ERNIE 4.5-VL: Video to Code Agent
This application is powered by Baidu ERNIE 4.5, a state-of-the-art foundation model with specific enhancements for video understanding:
- ๐๏ธ Multimodal Heterogeneous MoE: Uses dedicated vision experts to process images and video frames without interfering with text generation capabilities.
- โณ 3D-RoPE Temporal Modeling: Incorporates 3D Rotary Position Embeddings to independently encode temporal, width, and height information.
- ๐ Adaptive Resolution: Dynamically adjusts to different video aspect ratios to capture fine-grained code details.
- ๐ Long Context Window: Supports up to 128k context length for analyzing long tutorials.
Upload a video (e.g., a coding tutorial or a scene like skiing). The AI will watch it and generate a website based on the content.
โถ๏ธ Or try this example video: