GitXplorerGitXplorer
r

ego4dv2

public
5 stars
1 forks
0 issues

Commits

List of commits on branch main.
Unverified
c6f9824fa5359aa97c1762dcf71394f725972427

Remove gitignore, add lib

rrawalkhirodkar committed 2 years ago
Unverified
98540c930cc570e20a2ce79b144d2927ab0b3e71

Update url

rrawalkhirodkar committed 2 years ago
Unverified
1d12b3580adaba1b783689f5188b0e67a03d3b0d

Add camera alignment code

rrawalkhirodkar committed 2 years ago
Verified
dbd1541ba3db08ec8717969869c1d0cc10c4f4ed

Initial commit

rrawalkhirodkar committed 2 years ago

README

The README file for this repository.

Ego-Exo

Installation

  • Following the instructions in ./scripts/_install/conda.sh
  • It will create an conda environment "mmp" for you.

Data Setup

  • Please download two demo sequences calibration_uncego4d and 001_uncego4d.
  • Unzip, it contains the timesynced images and colmap calibration output.
  • Paste the "calibration_uncego4d" anmd '001_uncego4d' under the path '/media/rawalk/disk1/rawalk/datasets/ego_exo/main/uncego4d'. Or change the sequence paths in the scripts.

Camera Alignment

  • We align the aria cameras with the gopros using the colmap output using procrustes alignment.
  • cd scripts/1_process_ego
  • ./3_run_pa.sh
  • This will generate and save camera transforms "Aria to COLMAP" and "COLMAP to Aria" to the 'colmap/workplace' folder under 'calibration_uncego4d'

Camera Center Visualization

  • To check if the camera alignment was successful, we visualize the camera centers in the ego and exo views.
  • cd scripts/3_process_smpl
  • ./get_aria_locations.sh
  • Output saved to 'calibration_uncego4d/processed_data'. 'cyan' for gopro camera center, 'blue' for aria camera center.