TMPGEnc very pixelated

I'm using TMPGEnc DVD Author v3.0.9.166 and always use the same settings for different projects.
Now I'm authoring a dvd with motion menus for the first time.
In the main menu it's an avi with 2 mb. In the track menu it's an avi with 170 mb. The main movie is a ***.dvddata file with 2.3 gb.
The total project size is 2.480 gb.
After the output is started the menus take 50% of the total output, so the remaining 50% are for the main movie - wich is 2.3 gb! But when it finishes encoding the menus, in the output folder there are 2 VOBs with roughly the same size as the AVI files.
When everithing is finished the menus look fine, but the main movie is very pixelated. So I removed the motion menus, authored it again and the problem remains. Tried 2 pass VBR, changed to CBR and no luck.
In the edit window the movie looks fine, so I don't know where the pixelation comes from.
Any suggestion?

 

"The main movie is a ***.dvddata file with 2.3 gb".

Would you mind clarifying this a little? (***.dvddata file)??

 

***.dvddata is the file that you get when using the "source wizard" tool to import the video from a dvd.
It's a MPEG-2 video, 720x576, 25 fps, 4:3 PAL

 

I guess that I use this program so often that I now don't pay much attention to "the nuts and bolts". OK. Now you made me want to go start a project and see for myself. I'll be back.

 

"In the main menu it's an avi with 2 mb. In the track menu it's an avi with 170 mb. The main movie is a ***.dvddata file with 2.3 gb.
The total project size is 2.480 gb." - nefilimx

Does this mean that the two menu files came from a different source than the main movie file?

Also, now I found how you got that ***dvddata file. You ripped straight from the disc. I must admit that I didn't even know it could do that. That's how we came up with that strange file format instead of true DVD compliant files (e.g. .vob). I always rip to my harddrive first with DVD Shrink and then use the Source Wizard to import a video file.
And, I'm using the latest program version 3.1.1.176 so I doubt we're even looking at the same GUI. But I think we may be on to something here.

 

Yes, that's right.

I already finished 2 different projects, 1 in NTSC and another in PAL, also using the ***.dvddata method and they came out great.
Went back to the the inicial project and came out pixelated again.
Is there any way to check if the VOBs in the original disc are currupted? But if this is the case, why would it look OK in the edit window but not in the output?

 

You stumped me. Anybody else want to take a crack at this one?

 

Thanks for the effort Peshtigo.
Still have the problem, so if anyone wants to help, go ahead.

And I have a couple of questions about TMPGEnc:
1. if I have "play all" and "select chapter" buttons on a menu, is the highlight always on "play all" first?

2. if I have the same buttons set with "fade in", as soon as I start the disc, "play all" is already highlighted. Can I change this?