Kart Racing Pro Official Forum

General => General Discussion => Topic started by: PiBoSo on November 05, 2012, 08:56:19 PM

Title: Kinect
Post by: PiBoSo on November 05, 2012, 08:56:19 PM
At the following link: http://www.kartracing-pro.com/downloads/kinect.zip it is possible to download 3 DLL that enable Kinect support in Kart Racing Pro.

Requirements:
Kinect for Windows and Windows 7 or 8 ( Kinect for Xbox shouldn't be supported. Please report if it works ).

Installation:
Unpack the zip file in Kart Racing Pro installation folder. Then enable "Face Tracking" in Settings -> Simulation -> Free Look.

Remarks:
It is possible to add, in Kart Racing Pro installation folder, a text file named "kinect.ini" to set a few parameters:

[face_tracking]
smooth = 5
yaw_multiplier = 200
pitch_multiplier = 100
roll_multiplier = 0


A very fast CPU is needed.
Gestures support will be added later.
Title: Re: Kinect
Post by: ALEale on November 06, 2012, 10:44:06 AM
i have a kinect but in my xbox 360... next week can i try if it work... ( :-[ i've never modify .ini files )
Title: Re: Kinect
Post by: Dan Buck on November 06, 2012, 11:22:00 AM
you could post a video to show us how this works!! ;)
Title: Re: Kinect
Post by: dibu on November 13, 2012, 06:35:15 PM
Any news? ALEae please test it and report. I'm thinking about buying one for windows but I'm not sure because I'm using a beamer and the room is quite dark.

PiBoSo which functions exactly can we use it for? Turning the head? Better look at the apex? What else (KRP, GPBikes, WRS)?
Title: Re: Kinect
Post by: PiBoSo on November 13, 2012, 07:11:38 PM
Quote from: dibu on November 13, 2012, 06:35:15 PM
Any news? ALEae please test it and report. I'm thinking about buying one for windows but I'm not sure because I'm using a beamer and the room is quite dark.

PiBoSo which functions exactly can we use it for? Turning the head? Better look at the apex? What else (KRP, GPBikes, WRS)?

At the moment Kinect is used to rotate the onboard camera. The advantage is that it doesn't require to wear IR leds. Kinect does have an IR camera, but it hasn't been tested in dark conditions.
For the future, the plan is to integrate support in the next release of GP Bikes and WRS, and later to add gestures recognition.
Title: Re: Kinect
Post by: dibu on November 13, 2012, 07:21:25 PM
Thanks, I'll risk it. I've just ordered one ;D.
Title: Re: Kinect
Post by: dibu on November 17, 2012, 05:16:18 PM
The Kinect arrived today and I installed it with SDK 1.6. The demos of the SDK toolkit run and it's also recognized by KRP.

But here my problem starts. Most of it is related to the dark room with the beamer and the position of the Kinect in front of me and my wheel.

-The problem is that Kinect looses tracking of my face while driving.
(Not the fault of your dll, also the 'Face Tracking Visualization' demo sometimes looses contact.)

Especially the movement of my hands at the wheel seems to irritate it.
I have not much choise in positioning the unit because I have to avoid the beamer light. The unit is positioned in front of me but the wheel is also in the field of view and I can't set the Kinect higher.

Is there any way to do some fine tuning except the values you mentioned in your kinect.ini? e.g. brightness, contrast, angle ...
In the 'Kinect Explorer' I can change a lot of values but I can't use it while KRP has control. 
Does your kinect.dll read more values from the .ini?

From my first tests the combination Kinect+KRP has potential but I have to get it reliable.

Title: Re: Kinect
Post by: PiBoSo on November 18, 2012, 11:49:12 AM
Quote from: dibu on November 17, 2012, 05:16:18 PM
The Kinect arrived today and I installed it with SDK 1.6. The demos of the SDK toolkit run and it's also recognized by KRP.

But here my problem starts. Most of it is related to the dark room with the beamer and the position of the Kinect in front of me and my wheel.

-The problem is that Kinect looses tracking of my face while driving.
(Not the fault of your dll, also the 'Face Tracking Visualization' demo sometimes looses contact.)

Especially the movement of my hands at the wheel seems to irritate it.
I have not much choise in positioning the unit because I have to avoid the beamer light. The unit is positioned in front of me but the wheel is also in the field of view and I can't set the Kinect higher.

Is there any way to do some fine tuning except the values you mentioned in your kinect.ini? e.g. brightness, contrast, angle ...
In the 'Kinect Explorer' I can change a lot of values but I can't use it while KRP has control. 
Does your kinect.dll read more values from the .ini?

From my first tests the combination Kinect+KRP has potential but I have to get it reliable.

The best position to avoid hands problems should be on top of the screen.
At the moment there are no tuning parameters for the Kinect DLL. They will be added in future updates if useful for low-light conditions.
Title: Re: Kinect
Post by: dibu on November 18, 2012, 12:59:49 PM
Thanks. The picture shows the actual situation and I'll try to move the Kinect to the red marked position. I still need a good idea how I can mount it at the ceiling. ::)
Title: Re: Kinect
Post by: PiBoSo on November 18, 2012, 04:55:18 PM
Quote from: dibu on November 18, 2012, 12:59:49 PM
Thanks. The picture shows the actual situation and I'll try to move the Kinect to the red marked position. I still need a good idea how I can mount it at the ceiling. ::)

On the ceiling it should work much better. However, it would probably not work at all if installed upside-down.
Title: Re: Kinect
Post by: dibu on November 18, 2012, 06:02:05 PM
It's at the ceiling now (not upside-down) and it works much better. I also placed a small lamp in the room.

The situation now:
+ The Kinect doesn't loose contact anymore.

- The accuracy of the steering is still not satisfying. It doesn't always follow the movement of the head closely enough. Sometimes it also overreacts. I see the same behavior in the demo programs. It's still impossible to drive fast laps.

Maybe I'm too far away from the Kinect now for proper face tracking (1.7m Kinect - Face). Without tricks I can't position it nearer because I'm already using the maximum downside angle of -27°.

The CPU load for for Kinect + KRP is about 30-40% and the FPS are still 130-250. 


Title: Re: Kinect
Post by: PiBoSo on November 18, 2012, 06:28:10 PM

Sorry for the problems  :(
The Kinect DLL has been tested at a distance of around 80 cm and in sunlight or desk light conditions, with no problems.
At the moment it automatically uses "near mode". Maybe "default mode" could improve accuracy.
Title: Re: Kinect
Post by: dibu on November 18, 2012, 07:01:50 PM
Quote from: PiBoSo on November 18, 2012, 06:28:10 PM
Sorry for the problems  :(
Don't understand me wrong there was no criticism at all.  :) I knew what I'm doing when I bought it and that it will become an adventure to run it in my environment. I'm only reporting because it might help others to use the Kinect.

BTW I had already tested the "default mode" with the "Kinect Explorer" and there was no difference because 1.7m is in the range of both modes.
Title: Re: Kinect
Post by: PiBoSo on November 18, 2012, 08:08:57 PM
Quote from: dibu on November 18, 2012, 07:01:50 PM
BTW I had already tested the "default mode" with the "Kinect Explorer" and there was no difference because 1.7m is in the range of both modes.

Thank you for the report.
Then unfortunately at the moment there seem to be no options to have better tracking.
The only hopes are 1) face tracking will be more accurate with the data from skeleton tracking 2) MS will improve the SDK.
Title: Re: Kinect
Post by: dibu on November 23, 2012, 07:22:25 PM
I still don't want to give up. Now I know a bit more about the mannerisms of this diva.

I also found a better position (0.7m from face) but the angle is still a bit steep.
Would it be possible to adjust presets for pitch, yaw, roll, brightness and other useful parameters in future versions of your dll?
Is it also possible to use the infrared camera for face tracking? It could make illumination with IR-LEDs easier in a dark room.
Can you disable Kinects influence on the sound of KRP? This is quite irritating.
Title: Re: Kinect
Post by: PiBoSo on November 23, 2012, 09:39:35 PM
Quote from: dibu on November 23, 2012, 07:22:25 PM
I still don't want to give up. Now I know a bit more about the mannerisms of this diva.

I also found a better position (0.7m from face) but the angle is still a bit steep.
Would it be possible to adjust presets for pitch, yaw, roll, brightness and other useful parameters in future versions of your dll?
Is it also possible to use the infrared camera for face tracking? It could make illumination with IR-LEDs easier in a dark room.
Can you disable Kinects influence on the sound of KRP? This is quite irritating.

Brightness control can be added. It was integrated in version 1.6 of the SDK, but the DLL was written on version 1.5
There doesn't seem to be a way to set default face position relative to Kinect position.
The infrared camera should be already used automatically to build the depth data.
Kinect has no direct effect on sounds. The changes are probably due to the rotation of the listener relative to the sound sources.
Title: Re: Kinect
Post by: dibu on November 24, 2012, 12:58:39 PM
Quote from: PiBoSo on November 23, 2012, 09:39:35 PM
Kinect has no direct effect on sounds. The changes are probably due to the rotation of the listener relative to the sound sources.
Yes you are right I get the same (strange) sound effects if I use mouse control instead of the Kinect.

I could improve the drivability very much by adjusting the values in "kinect.ini". Now my lap times are back in the range of my PB.
It doesn't make me really faster but driving tight corners feels more naturally because you have a better look at the apex and the corner exit.
If I turn my head fast left right (e.g. Lonato middle section) the tracking isn't always perfect. I'll go on testing with better illumination of my face.

[face_tracking]
smooth = 5
yaw_multiplier = 80
pitch_multiplier = 10
roll_multiplier = 0

Title: Re: Kinect
Post by: Racer80 on November 02, 2015, 09:00:51 PM
is it the xbox 360 Kinect or the xbox one kinect
Title: Re: Kinect
Post by: PiBoSo on November 03, 2015, 12:37:16 AM
Quote from: Racer80 on November 02, 2015, 09:00:51 PM
is it the xbox 360 Kinect or the xbox one kinect

Windows Kinect.
Title: Re: Kinect
Post by: Racer80 on November 03, 2015, 10:14:34 PM
Thanks piboso
Title: Re: Kinect
Post by: Racer80 on November 03, 2015, 10:16:54 PM
Piboso, would my Xbox 360 work?
Title: Re: Kinect
Post by: PiBoSo on November 04, 2015, 01:19:03 PM
Quote from: Racer80 on November 03, 2015, 10:16:54 PM
Piboso, would my Xbox 360 work?

No.
Title: Re: Kinect
Post by: Racer80 on November 04, 2015, 08:25:31 PM
If I got the converter, would it work then?
Title: Re: Kinect
Post by: PiBoSo on November 12, 2015, 11:40:34 AM
Quote from: Racer80 on November 04, 2015, 08:25:31 PM
If I got the converter, would it work then?

Probably not. Apparently, the hardware is the same, but the Windows Kinect uses a different firmware.
Title: Re: Kinect
Post by: nguoilaodong on April 06, 2023, 05:53:13 AM
I was impressed by your writing. Your writing is impressive. I want to write like you.메이저카지노  (https://totomecca.com/)I hope you can read my post and let me know what to modify. My writing is in I would like you to visit my blog.
Title: Thanks all of you!
Post by: Thomasnak on February 09, 2024, 07:07:59 AM
Exceptionally delighted to be a part of this! The enthusiasm and thoughtfulness are really commendable. The info provided is fantastic!
 
Have a fantastic day!