โšก ERNIE 4.5-VL: Video to Code Agent

This application is powered by Baidu ERNIE 4.5, a state-of-the-art foundation model with specific enhancements for video understanding:

  • ๐Ÿ‘๏ธ Multimodal Heterogeneous MoE: Uses dedicated vision experts to process images and video frames without interfering with text generation capabilities.
  • โณ 3D-RoPE Temporal Modeling: Incorporates 3D Rotary Position Embeddings to independently encode temporal, width, and height information.
  • ๐Ÿ“ Adaptive Resolution: Dynamically adjusts to different video aspect ratios to capture fine-grained code details.
  • ๐Ÿš€ Long Context Window: Supports up to 128k context length for analyzing long tutorials.

Upload a video (e.g., a coding tutorial or a scene like skiing). The AI will watch it and generate a website based on the content.

โ–ถ๏ธ Or try this example video: