mirror of
https://gitcode.com/gh_mirrors/ope/OpenFace.git
synced 2025-12-30 13:02:30 +00:00
The project was tested on Matlab 2015a and 2015b on 64 bit Windows 7 and Windows 8 machines (can't guarantee compatibility with other configurations, but should work with newer versions).
Comes prepackaged with all the necessary code and some of the data (that I'm allowed to share). You have to respect nrsfm, OpenCV and other licenses.
To download the CEN models go to - https://www.dropbox.com/sh/o8g1530jle17spa/AADRntSHl_jLInmrmSwsX-Qsa?dl=0, place all of .mat files to ./models/cen and .dat files to ./lib/local/LandmarkDetector/model/patch_experts/
--------------------------------------- Copyright information -----------------------------------------------------------------------------
Copyright can be found in the copyright.txt
--------------------------------------- Code Layout -----------------------------------------------------------------------------
//======================= Core ========================//
./fitting - Where the actual CLM and CLNF model fitting happens
./models - the pre-trained models for CE-CLM, and Constrained Local Neural Fields, this includes Point Distribution Model, Patch experts, landmark validation
./CCNF - the libraries that contain CCNF functions needed for landmark detection
//======================= Demos and experiments =======//
./demo - contains a number of useful scripts that demonstrate the running of CLM, CLNF, and CE-CLM models on videos and images
face_image_demo - running CE-CLM, CLNF or CLM on images of faces
face_image_demo_eyes - running CE-CLM, CLNF or CLM on images of faces + eye landmark detection
face_image_depth_demo - running CLM-Z on grayscale and range images of faces
face_video_demo - running CE-CLM, CLNF or CLM on videos of faces
./experiments_300VW - These are provided for recreation of experiments on 300VW dataset
./experiments_300W - These are provided for recreation of some of the experiments described in the papers on 300W dataset
./experiments_JANUS - These are provided for recreation of some of the experiments described in the papers on IJB-FL dataset
./experiments_JANUS - These are provided for recreation of some of the experiments described in the papers on the menpo dataset (both cross and within data)
//======================= Utilities ===================//
./face_detection - Provides utilities for face detection, possible choices between four detectors: MTCNN (requires MatConvNet for speed), Matlab inbuilt one, Zhu and Ramanan, and Yu et al.
./face_detection_yu - The face detector from Xiang Yu, more details in ./face_detection_yu/README.txt. Only tested on windows machines
./face_detection_zhu - The face detector from Zhu and Ramanan, might need to compile it using ./face_detection_yu/face-release1.0-basic/compile.m
./mtcnn - The most recent and accurate model, MTCNN face detector based on the paper "Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Neural Networks" by Zhang et al.
./face_validation - A module for validating face detections (training and inference), it is used for tracking in videos so as to know when reinitialisation is needed
./PDM_helpers - utility functions that deal with PDM fitting, Jacobians and other shape manipulations
--------------------------------------- Results -----------------------------------------------------------------------------
Results that you should expect on running the code on the publicly available datasets can be found in:
./results folders in each of the experiment* folders
--------------------------------------- Final remarks -----------------------------------------------------------------------------
I did my best to make sure that the code runs out of the box but there are always issues and I would be grateful for your understanding that this is research code. However, if you encounter any probles please contact me at Tadas.Baltrusaitis@cl.cam.ac.uk for any bug reports/questions/suggestions.