Camera Tracker Utility
 
 
 
Command entry: Utilities panel Utilities rollout More button Utilities dialog Camera Tracker

The Camera Tracker utility synchronizes a background by animating the movement of a camera inside 3ds Max to match the movement of a real camera that was used to shoot a movie.

Procedures

To generate a camera match-move:

  1. Open the working scene in 3ds Max.

    The scene should have a Free camera to be match-moved, as the tracker does not create one. The scene also should have a set of Point or CamPoint helper objects positioned in 3D to correspond to the tracking features. Optionally install the movie as an environment map-based background image in the match camera viewport. This is needed if you want to render a composite using the match-move or checking match accuracy. This doesn’t automatically display the background image in the viewport. Use Views Background Image to select the background movie and display it in the viewport.

    Real-world camera films a scene (the white dots will be tracking points).

  2. Open the movie file in the Camera Tracker utility and create a set of feature tracking gizmos for each of the tracking features in the scene.

    Resulting footage to be tracked and used as a background.

  3. Position the Feature Selection box and Motion Search box for each gizmo so that they’re centered on the features and have motion search bounds large enough to accommodate the biggest frame-to-frame move of the features throughout the frames that will be tracked.
  4. Associate each tracker with its corresponding scene point object.

    The associated scene point objects are set up in 3D space based on real-world dimensions.

  5. (Optional) Use the Movie Stepper rollout to set the start and stop frames for each tracker if it’s out-of-view for any of the frames that will be matched. These specify the frame range during which the tracker is visible in the scene and will be tracked as part of the matching process. This mechanism allows you to match a move in which the view passes through a field of features with only some of them (at least six) visible at any time.
  6. (Optional) Set up manual keyframes for each tracker at frames in which the feature radically changes motion or shape or is briefly occluded and so might be difficult for the computer to track. If you want, you can do this after a tracking attempt indicates where tracking errors occurred.
  7. Perform the feature track using the Batch Track rollout. This is often an iterative process: correcting for tracking errors by tuning start and stop frames or manually repositioning the gizmo and motion search boxes at error frames. When you reposition a gizmo at some frame, you establish a new target feature image and subsequent frames up to the next keyframe will be retracked. You can use the error detecting features in the tracker to step through possible tracking errors. When complete, this process builds a table of 2D motion positions for each feature. You can save this to disk using the Save button on the Movie rollout.
  8. Choose the camera that will be matched in the Match-Move rollout, select which camera parameters you want to estimate, set the movie and scene animation frame ranges and perform the match. This generates a keyframed animation of the selected camera parameters.

    After camera tracking, scene geometry (the character) matches the filmed background.

  9. Check the match for obvious errors and review the tracker gizmo positions at these frames. You can manually adjust gizmos at these frames and the matcher interactively recomputes the camera position.
  10. (Optional) Apply smoothing to selected camera parameters and recompute a compensating match for the other parameters.

The Camera Tracker also has the ability to animate 3ds Max geometry to follow or match the video by following the movement of a tracker in a 2D plane. For this type of animation scene measurements aren’t required. Use the Object Pinning rollout of the Camera Tracker to create this type of tracking.

  • Requirements for Camera Tracking

    Using the Camera Tracker requires some setup, as this topic describes.

  • Camera Tracker: Movie Rollout

    Opens the movie for tracking. Also provides controls for the display of the movie, including fade display to improve the visibility of the trackers. Provides controls for loading and saving MOT files in which tracker information is stored.

  • Camera Tracker: Movie Window

    The tracker gizmo displayed in the Movie window consists of two enclosed boxes, a central pair of cross hairs, and a tracker number.

  • Camera Tracker: Motion Trackers Rollout

    The Camera Tracker utility's Motion Trackers rollout sets up and controls the image feature trackers. All the trackers created are listed here: showing enable check mark, tracker number, associated scene point object name, and active frame range. To select a tracker, click in the list. Provides controls for subpixel tracking as well.

  • Camera Tracker: Movie Stepper Rollout

    The Camera Tracker utility's Movie Stepper rollout browses through the movie during the tracking phase either to set start and stop frames, to review tracking results or to manually perform a track over a sequence of frames. The Movie Stepper rollout consists of a frame counter, a set of stepper buttons, and some option check boxes.

  • Camera Tracker: Error Thresholds Rollout

    The Camera Tracker utility's Error Thresholds rollout attempts to identify feature tracking errors by taking measurements and comparing them to the thresholds that you set up in this rollout. You can use this detection can be used both during a manual tracking review (see Batch Track Rollout) or during actual tracking to correct errors using the Resample On Error control in the Motion Trackers setup rollout.

  • Camera Tracker: Batch Track Rollout

    The Camera Tracker utility's Batch Track rollout performs feature hands-off tracking once the trackers have been set up. You can set up a set of trackers, start a batch tracking of them all, and then use the other tools in this panel to check for and review detected tracking errors. This panel also checks for tracking completion.

  • Camera Tracker: Position Data Rollout

    This rollout lets you manage position data.

  • Camera Tracker: Match Move Rollout

    The Camera Tracker utility's Match Move rollout automatically generates a camera animation by correlating the 2D position data of the movie features gathered during the tracking phase with the associated 3D feature points in the 3ds Max scene.

  • Camera Tracker: Move Smoothing Rollout

    Because the match-move algorithm is not always exact and is highly susceptible to field measurement error or feature tracking errors, and because the match for each frame is computed independently, the results can be "noisy", particularly if field of view is estimated. In match-move situations where the real camera performs smooth moves, it might be useful to filter the match results to eliminate this noise.

  • Camera Tracker: Object Pinning Rollout

    Object Pinning lets you use the 2D image feature tracking data to directly animate objects in the 3ds Max scene. This is useful for replacing moving features in the scene with 3D objects when the movement is approximately planar.

  • Camera Tracker: Troubleshooting

    This topic describes some common problems you might encounter when using the Camera Tracker, and gives suggestions about how to fix them.