Motion Picture·Analysis·Generation·Interaction·Creation

Explore Us Join Us

About Magic

MAGIC Lab is affiliated with Shanghai University and the Shanghai Film Special Effects Engineering Research Center (a provincial/ministerial-level center), with Dr. Mengtian Li serving as the Principal Investigator (PI). We focus on a series of research areas within AI&EI for Art. Our goal is to empower the development and innovation of artistic fields such as film, theater, gaming, and cultural entertainment through Artificial Intelligence (AI) and Embodied Intelligence (EI) technologies. The laboratory's research directions include:

  1. Digital Content Understanding and Generation for Film, Theater, Gaming, and Cultural Entertainment:

    • Scenes: Understanding and generating artistic scenes and objects of various scales in accordance with script narratives and artistic aesthetics.
    • Humans: Creating various types of virtual characters based on all human attributes such as motion, expressions, language, and emotion.
    • Others: Understanding and generating content for the pre-production, production, and post-production stages of film, theater, and game production (e.g., scriptwriting, previsualization, shooting, sound, lighting, editing, color grading, publicity, etc.).
  2. Human-Computer Interaction (e.g., intelligent film sets, intelligent theaters, intelligent cultural tourism, interactive games): Collaborating with relevant teams from the Shanghai Film Academy, Shanghai Theatre Academy, and Fudan University to explore embodied machine intelligence perception/interaction systems for artistic application scenarios.

  3. AI&EI Artistic Creation: Collaborating with MFA (Master of Fine Arts) students specializing in directing/screenwriting within the lab to empower artistic creation with technology, exploring the emergence of new art forms (e.g., AIGC Film).

We pursue freedom and rationality, striving to foster an open, united, and vibrant research atmosphere that encourages interdisciplinary exchange and collaboration:

  • Weekly group meetings are conducted in one-on-one or small group discussion formats, tailored to actual needs.
  • The laboratory organizes seminars periodically, such as reading sessions for oral papers from top conferences in CV, CG, and ML (Computer Vision, Computer Graphics, Machine Learning), and workshops on new technologies. These are arranged based on demand to ensure all members stay abreast of academic frontiers and update their knowledge.
  • Regarding publications, we pursue and encourage submissions to international top-tier conferences and journals in Computer Vision, Computer Graphics, and Machine Learning (e.g., SIGGRAPH, SIGGRAPH Asia, CVPR, ICCV, ECCV, ICLR, ICML, NeurIPS, TPAMI, TOG, TVCG, etc.), aiming for this goal while not obligatory.
  • We provide sufficient research funding, hardware facilities, and opportunities for internships at renowned laboratories and leading companies.

MAGIC隶属于上海大学,上海电影特效工程研究中心(省部级),实验室负责人(PI)是李梦甜博士。我们专注AI&EIforArt领域的系列研究。我们的目标是让人工智能和具身智能技术,赋能影视、戏剧、游戏、文旅等艺术领域的发展和创新。实验室的研究方向包括:

  1. 面向影视、戏剧、游戏、文旅领域的数字内容理解与生成

    • 场景:对不同尺度的艺术场景、物体进行符合剧本叙事和艺术美学的理解与生成;
    • 人:从动作、表情、语音、情感等一切人类所有的属性制作各种类型的虚拟演员;
    • 其他:对影视、戏剧、游戏制作的前期、中期、后期(如剧本、预演、拍摄、声音、灯光、剪辑、调色、宣发等)进行理解与生成;
  2. 人机交互(如智能片场、智能剧场、智能文旅、交互游戏等),与上海电影学院、上海戏剧学院、复旦大学的相关团队展开合作,探索面向艺术应用场景的具身机器智能感知/交互系统。

  3. AI&EI for 艺术创作,与实验室的导演/编剧方向的MFA艺术硕士合作,用技术赋能艺术创作,尝试催生新的艺术形式(如AIGCFilm)。

我们追求自由与理性,努力营造开放、团结、活泼的研究氛围,鼓励跨领域的交流与合作:

  • 每周组会有一对一小组讨论两种形式,根据实际需求进行。
  • 实验室不定期组织讨论班,如CV、CG、ML顶会Oral论文围读会,新技术讲习会等,根据实际需求进行,让每位同学掌握学术最前沿动态、更新知识。
  • 论文方面,我们追求并鼓励投稿计算机视觉、计算机图形学、机器学习方向的顶级会议和期刊(如SIGGRAPH、SIGGRAPH Asia、CVPR、ICCV、ECCV、ICLR、ICML、NeurIPS、TPAMI、TOG、TVCG等)
  • 提供足够的研究资金和硬件设施,以及知名实验室和头部公司合作实习的机会。

News

  • June 30, 2025 Congratulations to Chengshuo Zhai and Shengxiang Yao on graduating from the research group!
  • Mar 16, 2025 Three papers were accepted in CVPR2025!
  • Dec 21, 2024 Two papers were accepted in ICASSP2025!
  • Dec 11, 2024 One paper was accepted in AAAI2025!
  • Nov 01, 2024 Granted by the Shanghai ‘Science and Technology Innovation Action Plan’ Natural Science Fund(上海市“科技创新行动计划”自然科学基金项目)
  • Aug 25, 2024 Granted by the National Natural Science Foundation of China (国家自然科学基金青年科学基金项目)
  • Feb 27, 2024 One paper was accepted in CVPR2024!

Latest Publications

Team Member

Mengtian Li

Assistant Professor
Meghna

Zhifeng Xie

Associate Professor
Meghna

Chengshuo Zhai

Master Student (Graduated)
Meghna

Shengxiang Yao

Master Student (Graduated)
Meghna

Fan Yang

Master Student
Meghna

Yunshu Bai

Master Student
Meghna

Kunyan Dai

Master Student

Yuwei Lu

Master Student
Meghna

Sifan Xiong

Master Student
Meghna

Xinru Guo

Master Student
Meghna

Yiyan Fan

Master Student
Meghna

Ruixue Xiong

Master Student
Meghna

Jiawei Zeng

Master Student
Meghna

YukunZhang

Master Student
Meghna

LinYang

Master Student
Meghna

FeifeiLi

Undergraduate Internship
Meghna

BotaoQing

Undergraduate Internship
Meghna

YichenPan

Undergraduate Internship
Meghna

YiDing

Undergraduate Internship
Meghna

YimingChu

Undergraduate Internship
Meghna

XiaoruLin

Undergraduate Internship
Meghna

YuxinDing

Undergraduate Internship
Meghna

YuanyuanSong

Undergraduate Internship
Meghna

LingWang

Undergraduate Internship
Meghna

YijunShen

Undergraduate Internship
Meghna

RuobingNi

Undergraduate Internship