google/mediapipe|计算机视觉|机器学习|深度学习|-AI研习社

layout: default title: Home nav_order: 1

MediaPipe

Live ML anywhere

MediaPipe offers cross-platform, customizable ML solutions for live and streaming media.


*End-to-End acceleration: Built-in fast ML inference and processing accelerated even on common hardware*	*Build once, deploy anywhere: Unified solution works across Android, iOS, desktop/cloud, web and IoT*

*Ready-to-use solutions: Cutting-edge ML solutions demonstrating full power of the framework*	*Free and open source: Framework and solutions both under Apache 2.0, fully extensible and customizable*

ML solutions in MediaPipe

Face Detection	Face Mesh	Iris	Hands	Pose	Holistic

Hair Segmentation	Object Detection	Box Tracking	Instant Motion Tracking	Objectron	KNIFT

	Android	iOS	C++	Python	JS	Coral
Face Detection	✅	✅	✅			✅
Face Mesh	✅	✅	✅	✅	✅
Iris	✅	✅	✅
Hands	✅	✅	✅	✅	✅
Pose	✅	✅	✅	✅	✅
Holistic	✅	✅	✅	✅	✅
Hair Segmentation	✅		✅
Object Detection	✅	✅	✅			✅
Box Tracking	✅	✅	✅
Instant Motion Tracking	✅
Objectron	✅
KNIFT	✅
AutoFlip			✅
MediaSequence			✅
YouTube 8M			✅

See alsoMediaPipe Models and Model Cardsfor ML models released in MediaPipe.

MediaPipe in Python

MediaPipe offers customizable Python solutions as a prebuilt Python package onPyPI, which can be installed simply withpip install mediapipe. It also provides tools for users to build their own solutions. Please seeMediaPipe in Pythonfor more info.

MediaPipe on the Web

MediaPipe on the Web is an effort to run the same ML solutions built for mobile and desktop also in web browsers. The official API is under construction, but the core technology has been proven effective. Please seeMediaPipe on the Webin Google Developers Blog for details.

You can use the following links to load a demo in the MediaPipe Visualizer, and over there click the "Runner" icon in the top bar like shown below. The demos use your webcam video as input, which is processed all locally in real-time and never leaves your device.

visualizer_runner

Getting started

Learn how to installMediaPipe andbuild example applications, and start exploring our ready-to-usesolutions that you can further extend and customize.

The source code is hosted in theMediaPipe Github repository, and you can run code search usingGoogle Open Source Code Search.

Publications

MediaPipe Holistic - Simultaneous Face, Hand and Pose Prediction, on Devicein Google AI Blog
Background Features in Google Meet, Powered by Web MLin Google AI Blog
MediaPipe 3D Face Transformin Google Developers Blog
Instant Motion Tracking With MediaPipein Google Developers Blog
BlazePose - On-device Real-time Body Pose Trackingin Google AI Blog
MediaPipe Iris: Real-time Eye Tracking and Depth Estimationin Google AI Blog
MediaPipe KNIFT: Template-based feature matchingin Google Developers Blog
Alfred Camera: Smart camera features using MediaPipein Google Developers Blog
Real-Time 3D Object Detection on Mobile Devices with MediaPipein Google AI Blog
AutoFlip: An Open Source Framework for Intelligent Video Reframingin Google AI Blog
MediaPipe on the Webin Google Developers Blog
Object Detection and Tracking using MediaPipein Google Developers Blog
On-Device, Real-Time Hand Tracking with MediaPipein Google AI Blog
MediaPipe: A Framework for Building Perception Pipelines

Videos

YouTube Channel

Events

Community

Awesome MediaPipe - A curated list of awesome MediaPipe related frameworks, libraries and software
Slack community for MediaPipe users
Discuss - General community discussion around MediaPipe

Alpha disclaimer

MediaPipe is currently in alpha at v0.7. We may be still making breaking API changes and expect to get to stable APIs by v1.0.

Contributing

We welcome contributions. Please follow theseguidelines.

We use GitHub issues for tracking requests and bugs. Please post questions to the MediaPipe Stack Overflow with a mediapipe tag.