OpenCV AR utilities. More...

Classes
struct	PoseData

Static Public Member Functions
static float	CalculateDistance (float frustumSize, float fov)
	Calculate distance. https://docs.unity3d.com/Manual/FrustumSizeAtDistance.html.

static float	CalculateFOVAngle (float frustumSize, float distance)
	Calculate FOV angle. https://docs.unity3d.com/Manual/FrustumSizeAtDistance.html.

static float	CalculateFrustumSize (float distance, float fov)
	Calculate frustum size. https://docs.unity3d.com/Manual/FrustumSizeAtDistance.html.

static Matrix4x4	CalculateProjectionMatrixFromCameraMatrixValues (float fx, float fy, float cx, float cy, float width, float height, float near, float far)
	Calculate projection matrix from camera matrix values. (OpenCV coordinate system to OpenGL coordinate system)

static Matrix4x4	CameraMatrixValuesFromCalculateProjectionMatrix (Matrix4x4 projectionMatrix, float width, float height, float fovV)
	Calculate camera matrix values from projection matrix. (OpenGL coordinate system to OpenCV coordinate system)

static void	ComposeMatrix (Vector3 localPosition, Quaternion localRotation, Vector3 localScale, out Matrix4x4 matrix)
	Compose TRS matrix from position, rotation and scale.

static PoseData	ConvertMatrixToPoseData (ref Matrix4x4 matrix)
	Convertes transform matrix to PoseData.

static Matrix4x4	ConvertPoseDataToMatrix (ref PoseData poseData, bool toLeftHandCoordinateSystem=false)
	Convertes PoseData to transform matrix.

static Quaternion	ConvertRvecToRot (double[] rvec)
	Convertes rvec value to rotation transform.

static Quaternion	ConvertRvecToRot (Mat rvec)
	Convertes rvec value to rotation transform.

static PoseData	ConvertRvecTvecToPoseData (double[] rvec, double[] tvec)
	Convertes rvec and tvec value to PoseData.

static PoseData	ConvertRvecTvecToPoseData (Mat rvec, Mat tvec)
	Convertes rvec and tvec value to PoseData.

static Vector3	ConvertTvecToPos (double[] tvec)
	Convertes tvec value to position transform.

static Vector3	ConvertTvecToPos (Mat tvec)
	Convertes tvec value to position transform.

static Dictionary< int, PoseData >	CreatePoseDataDict (int[] ids, double[] rvecs, double[] tvecs)
	Creates pose data dictionary.

static void	DecomposeMatrix (ref Matrix4x4 matrix, out Vector3 localPosition, out Quaternion localRotation, out Vector3 localScale)
	Extract position, rotation and scale from TRS matrix.

static Quaternion	ExtractRotationFromMatrix (ref Matrix4x4 matrix)
	Extract rotation quaternion from transform matrix.

static Vector3	ExtractScaleFromMatrix (ref Matrix4x4 matrix)
	Extract scale from transform matrix.

static Vector3	ExtractTranslationFromMatrix (ref Matrix4x4 matrix)
	Extract translation from transform matrix.

static void	LowpassPoseData (ref PoseData oldPose, ref PoseData newPose, float posThreshold, float rotThreshold)
	Performs a lowpass check on the position and rotation in newPose, comparing them to oldPose.

static void	LowpassPoseDataDict (Dictionary< int, PoseData > oldDict, Dictionary< int, PoseData > newDict, float posThreshold, float rotThreshold)
	Performs a lowpass check on the position and rotation of each marker in newDict, comparing them to those in oldDict.

static void	SafeDrawFrameAxes (Mat image, Mat cameraMatrix, Mat distCoeffs, Mat rvec, Mat tvec, float length, int thickness=3)
	Safe version of drawFrameAxes that prevents hang or crashes when tvec has zero or near-zero Z component. Draw axes of the world/object coordinate system from pose estimation.

static void	SetTransformFromMatrix (Transform transform, ref Matrix4x4 matrix)
	Set transform component from TRS matrix.

Detailed Description

OpenCV AR utilities.

Member Function Documentation

◆ CalculateDistance()

static float OpenCVForUnity.UnityIntegration.OpenCVARUtils.CalculateDistance	(	float	frustumSize,
		float	fov )

static

Calculate distance. https://docs.unity3d.com/Manual/FrustumSizeAtDistance.html.

Parameters

frustumHeight	One side size of a frustum.
fov	Field of view. (horizontal or vertical direction)

Returns: Distance.

◆ CalculateFOVAngle()

static float OpenCVForUnity.UnityIntegration.OpenCVARUtils.CalculateFOVAngle	(	float	frustumSize,
		float	distance )

static

Calculate FOV angle. https://docs.unity3d.com/Manual/FrustumSizeAtDistance.html.

Parameters

frustumHeight	One side size of a frustum.
distance	Distance.

Returns: FOV angle.

◆ CalculateFrustumSize()

static float OpenCVForUnity.UnityIntegration.OpenCVARUtils.CalculateFrustumSize	(	float	distance,
		float	fov )

static

Calculate frustum size. https://docs.unity3d.com/Manual/FrustumSizeAtDistance.html.

Parameters

distance	Distance.
fov	Field of view. (horizontal or vertical direction)

Returns: Frustum height.

◆ CalculateProjectionMatrixFromCameraMatrixValues()

static Matrix4x4 OpenCVForUnity.UnityIntegration.OpenCVARUtils.CalculateProjectionMatrixFromCameraMatrixValues	(	float	fx,
		float	fy,
		float	cx,
		float	cy,
		float	width,
		float	height,
		float	near,
		float	far )

static

Calculate projection matrix from camera matrix values. (OpenCV coordinate system to OpenGL coordinate system)

Parameters

fx	Focal length x.
fy	Focal length y.
cx	Image center point x.(principal point x)
cy	Image center point y.(principal point y)
width	Image width.
height	Image height.
near	The near clipping plane distance.
far	The far clipping plane distance.

Returns: Projection matrix.

◆ CameraMatrixValuesFromCalculateProjectionMatrix()

static Matrix4x4 OpenCVForUnity.UnityIntegration.OpenCVARUtils.CameraMatrixValuesFromCalculateProjectionMatrix	(	Matrix4x4	projectionMatrix,
		float	width,
		float	height,
		float	fovV )

static

Calculate camera matrix values from projection matrix. (OpenGL coordinate system to OpenCV coordinate system)

Parameters

projectionMatrix	Projection matrix.
width	Image width.
height	Image height.
fovV	Vertical field of view.

Returns: Camera matrix values. (fx = matrx.m00, fy = matrx.m11, cx = matrx.m02, cy = matrx.m12)

◆ ComposeMatrix()

static void OpenCVForUnity.UnityIntegration.OpenCVARUtils.ComposeMatrix	(	Vector3	localPosition,
		Quaternion	localRotation,
		Vector3	localScale,
		out Matrix4x4	matrix )

static

Compose TRS matrix from position, rotation and scale.

Parameters

localPosition	Position.
localRotation	Rotation.
localScale	Scale.
matrix	Transform matrix.

◆ ConvertMatrixToPoseData()

static PoseData OpenCVForUnity.UnityIntegration.OpenCVARUtils.ConvertMatrixToPoseData ( ref Matrix4x4 matrix )

static

Convertes transform matrix to PoseData.

Parameters

matrix Transform matrix.

Returns: PoseData.

◆ ConvertPoseDataToMatrix()

static Matrix4x4 OpenCVForUnity.UnityIntegration.OpenCVARUtils.ConvertPoseDataToMatrix	(	ref PoseData	poseData,
		bool	toLeftHandCoordinateSystem = false )

static

Convertes PoseData to transform matrix.

Parameters

posedata	PoseData.
toLeftHandCoordinateSystem	Determines if convert the transformation matrix to the left-hand coordinate system.

Returns: Transform matrix.

◆ ConvertRvecToRot() [1/2]

static Quaternion OpenCVForUnity.UnityIntegration.OpenCVARUtils.ConvertRvecToRot ( double[] rvec )

static

Convertes rvec value to rotation transform.

Parameters

tvec Rvec.

Returns: Rotation.

◆ ConvertRvecToRot() [2/2]

static Quaternion OpenCVForUnity.UnityIntegration.OpenCVARUtils.ConvertRvecToRot ( Mat rvec )

static

Convertes rvec value to rotation transform.

Parameters

tvec Rvec.

Returns: Rotation.

◆ ConvertRvecTvecToPoseData() [1/2]

static PoseData OpenCVForUnity.UnityIntegration.OpenCVARUtils.ConvertRvecTvecToPoseData	(	double[]	rvec,
		double[]	tvec )

static

Convertes rvec and tvec value to PoseData.

Parameters

tvec	Rvec.
tvec	Tvec.

Returns: PoseData.

◆ ConvertRvecTvecToPoseData() [2/2]

static PoseData OpenCVForUnity.UnityIntegration.OpenCVARUtils.ConvertRvecTvecToPoseData	(	Mat	rvec,
		Mat	tvec )

static

Convertes rvec and tvec value to PoseData.

Parameters

tvec	Rvec.
tvec	Tvec.

Returns: PoseData.

◆ ConvertTvecToPos() [1/2]

static Vector3 OpenCVForUnity.UnityIntegration.OpenCVARUtils.ConvertTvecToPos ( double[] tvec )

static

Convertes tvec value to position transform.

Parameters

tvec Tvec.

Returns: Position.

◆ ConvertTvecToPos() [2/2]

static Vector3 OpenCVForUnity.UnityIntegration.OpenCVARUtils.ConvertTvecToPos ( Mat tvec )

static

Convertes tvec value to position transform.

Parameters

tvec Tvec.

Returns: Position.

◆ CreatePoseDataDict()

static Dictionary< int, PoseData > OpenCVForUnity.UnityIntegration.OpenCVARUtils.CreatePoseDataDict	(	int[]	ids,
		double[]	rvecs,
		double[]	tvecs )

static

Creates pose data dictionary.

Parameters

ids	ids.
rvecs	Rvecs.
tvecs	Tvecs.

Returns: PoseData dictionary.

◆ DecomposeMatrix()

static void OpenCVForUnity.UnityIntegration.OpenCVARUtils.DecomposeMatrix	(	ref Matrix4x4	matrix,
		out Vector3	localPosition,
		out Quaternion	localRotation,
		out Vector3	localScale )

static

Extract position, rotation and scale from TRS matrix.

Parameters

matrix	Transform matrix. This parameter is passed by reference to improve performance; no changes will be made to it.
localPosition	Position.
localRotation	Rotation.
localScale	Scale.

◆ ExtractRotationFromMatrix()

static Quaternion OpenCVForUnity.UnityIntegration.OpenCVARUtils.ExtractRotationFromMatrix ( ref Matrix4x4 matrix )

static

Extract rotation quaternion from transform matrix.

Parameters

matrix Transform matrix. This parameter is passed by reference to improve performance; no changes will be made to it.

Returns: Quaternion representation of rotation transform.

◆ ExtractScaleFromMatrix()

static Vector3 OpenCVForUnity.UnityIntegration.OpenCVARUtils.ExtractScaleFromMatrix ( ref Matrix4x4 matrix )

static

Extract scale from transform matrix.

Parameters

matrix Transform matrix. This parameter is passed by reference to improve performance; no changes will be made to it.

Returns: Scale vector.

◆ ExtractTranslationFromMatrix()

static Vector3 OpenCVForUnity.UnityIntegration.OpenCVARUtils.ExtractTranslationFromMatrix ( ref Matrix4x4 matrix )

static

Extract translation from transform matrix.

Parameters

matrix Transform matrix. This parameter is passed by reference to improve performance; no changes will be made to it.

Returns: Translation offset.

◆ LowpassPoseData()

static void OpenCVForUnity.UnityIntegration.OpenCVARUtils.LowpassPoseData	(	ref PoseData	oldPose,
		ref PoseData	newPose,
		float	posThreshold,
		float	rotThreshold )

static

Performs a lowpass check on the position and rotation in newPose, comparing them to oldPose.

Parameters

oldPose	Old PoseData.
newPose	New PoseData.
posThreshold	Position threshold.
rotThreshold	Rotation threshold.

◆ LowpassPoseDataDict()

static void OpenCVForUnity.UnityIntegration.OpenCVARUtils.LowpassPoseDataDict	(	Dictionary< int, PoseData >	oldDict,
		Dictionary< int, PoseData >	newDict,
		float	posThreshold,
		float	rotThreshold )

static

Performs a lowpass check on the position and rotation of each marker in newDict, comparing them to those in oldDict.

Parameters

oldDict	Old dictionary.
newDict	New dictionary.
posThreshold	Position threshold.
rotThreshold	Rotation threshold.

◆ SafeDrawFrameAxes()

static void OpenCVForUnity.UnityIntegration.OpenCVARUtils.SafeDrawFrameAxes	(	Mat	image,
		Mat	cameraMatrix,
		Mat	distCoeffs,
		Mat	rvec,
		Mat	tvec,
		float	length,
		int	thickness = 3 )

static

Safe version of drawFrameAxes that prevents hang or crashes when tvec has zero or near-zero Z component. Draw axes of the world/object coordinate system from pose estimation.

See also: solvePnP

Parameters

image	Input/output image. It must have 1 or 3 channels. The number of channels is not altered.
cameraMatrix	Input 3x3 floating-point matrix of camera intrinsic parameters. \(\cameramatrix{A}\)
distCoeffs	Input vector of distortion coefficients \(\distcoeffs\). If the vector is empty, the zero distortion coefficients are assumed.
rvec	Rotation vector (see Rodrigues ) that, together with tvec, brings points from the model coordinate system to the camera coordinate system.
tvec	Translation vector.
length	Length of the painted axes in the same unit than tvec (usually in meters).
thickness	Line thickness of the painted axes.

OX is drawn in red, OY in green and OZ in blue. It includes safety checks to prevent crashes when tvec has invalid Z values.

◆ SetTransformFromMatrix()

static void OpenCVForUnity.UnityIntegration.OpenCVARUtils.SetTransformFromMatrix	(	Transform	transform,
		ref Matrix4x4	matrix )

static

Set transform component from TRS matrix.

Parameters

transform	Transform component.
matrix	Transform matrix. This parameter is passed by reference to improve performance; no changes will be made to it.

The documentation for this class was generated from the following file:

OpenCVForUnity/Assets/OpenCVForUnity/org/opencv/unity/OpenCVARUtils.cs

Classes

Static Public Member Functions

Detailed Description

Member Function Documentation

◆ CalculateDistance()

◆ CalculateFOVAngle()

◆ CalculateFrustumSize()

◆ CalculateProjectionMatrixFromCameraMatrixValues()

◆ CameraMatrixValuesFromCalculateProjectionMatrix()

◆ ComposeMatrix()

◆ ConvertMatrixToPoseData()

◆ ConvertPoseDataToMatrix()

◆ ConvertRvecToRot() [1/2]

◆ ConvertRvecToRot() [2/2]

◆ ConvertRvecTvecToPoseData() [1/2]

◆ ConvertRvecTvecToPoseData() [2/2]

◆ ConvertTvecToPos() [1/2]

◆ ConvertTvecToPos() [2/2]

◆ CreatePoseDataDict()

◆ DecomposeMatrix()

◆ ExtractRotationFromMatrix()

◆ ExtractScaleFromMatrix()

◆ ExtractTranslationFromMatrix()

◆ LowpassPoseData()

◆ LowpassPoseDataDict()

◆ SafeDrawFrameAxes()

◆ SetTransformFromMatrix()