UMR CNRS 7253

Site Tools


en:pfseq

PFSeq : A photorealistic fisheye sequence to evaluate self-calibration, stereo matching, feature points detection and matching, sky segmentation

License: ODbL-1.0
This PFSeq dataset is made available under the Open Database License: http://opendatacommons.org/licenses/odbl/1.0/. Any rights in individual contents of the database are licensed under the Database Contents License: http://opendatacommons.org/licenses/dbcl/1.0/

If you use this work, please cite: TODO

Targeted applications:

  • Fisheye camera intrinsics self-calibration (used with an algorithm needing an initial guess of the field of view, fixed at 180 degrees).
  • Fisheye stereo setup extrinsics delf-calibration (rotation and translation, up to a scale)
  • Stereo matching (with the distance maps)
  • Feature points evaluation (using distance maps to recover true matching points)
  • Sky segmentation

Download:
Link to be done. Currently, you can request the data by sending an e-mail to me.

Description

This simulated sequence has been created with Blender (using Cycles engine and the Compositor) between 2013 and 2015, in the context of my PhD thesis “Construction of 3D models from fisheye video data—Application to the localisation in urban area”. It depicts an urban canyon, with fisheye cameras facing the sky. It has been motivated by the absence of previous similar data, and by the need of perfect ground truth, that remains an open problem with real acquisition. To reach photorealistic rendering, care has been done on following aspects:

  • Buildings’ textures are issued from real photos.
  • A blueish area makes the transition of the image circle *.
  • Purple fringing issued from chromatic aberrations *.
  • Lens flare when the sun is visible *.
  • Optical dispersion blur *.
  • Motion blur *.

Setup:
Stereo setup with a baseline of 2m along X axis, and a rotational shift on rear camera:

Axis X Y Z
Rear camera rotation -8° -7°

Cameras have a high resolution of 1200×1200 pixels and an effective field of view of 181.8 degrees. Two variants with different fisheye projections:

  • equidistant projection: r = f . θ
  • equisolid angle projection: r = 2 . f . sin(θ/2)

For each variant, data are available in two versions: with and without realistic optical and motion distortions, depicted with a *.

Data format:
Images are given in lossless RGB png format, sky masks are given in lossless greylevels png format (only 2 colors: black 0 and white 255), distance maps are given in lossless 32 bits floating point exr format (3 equal channels with distance values in metres, and maximum value set to 500.0).

Data organisation:

/equidistant	/back	/depth		Image0000 to Image0075.exr
			/sky		Image0000 to Image0075.png
			/zerodefect	Image0000 to Image0075.png
			Image0000 to Image0075.png
		/front	...
/equisolid	...

Usage example of distance maps (python3):

import numpy as np
import skimage
from skimage.io import imread
from matplotlib import pyplot as plt
I = imread('Image0000.exr')[:,:,0]
I[I>500] = 500
plt.imshow(I, cmap='gray', vmin=0, vmax=50)
plt.show()


This work has been carried out within the ANR MEDDTL PREDIT CAPLOC project https://temis.documentation.developpement-durable.gouv.fr/document.html?id=Temis-0084273.


User Tools