[Utility] Chunk Extractor v2.0.0.1

Jayrod · 12:48 AM

v2.0.0.1

Tiny update: Finally decoded TXXF properly. UVs *should* be correct now in all instances. Give me a shout if you spot any problems.

* If you don't have a 3DMM file handy, I have provided a link for you. Check the bottom of this post. *

Release Notes
Chunk Extractor is evolving into a bigger program. Unfortunately, some features have been lost since the previous rendition due to constant rewriting. I have included the download link for the previous version down below, should you like to use it until more features arrive.

What's new:

Added a toggle between standard and grouped list (standard being what you're used to if you use Frankie's 3DMM Pencil++)

BMDLs no longer spin. You can adjust the camera yourself.

Full body Actor / Prop preview with features including:

Rotatable / zoomable viewport.
Animated figure (Actions)
Costume-able figure.

Chunk Explorer v2.0.0.0:

Chunk Extractor v1.0.1.0

Download the latest software (v2.0.0.1):
http://liambrocklehurst.com/uploader...r-v2.0.0.1.zip

Download Chunk Extractor v1.0.1.0:
http://liambrocklehurst.com/uploader...t_v1.0.1.0.zip

Other Downloads:
Broken Pencil's MEGA Folder
^ Older versions of the program among other things can be found here.

If you don't have a 3DMM file handy and you want to try this out, grab the original Patrick from:
http://liambrocklehurst.com/uploader...atrick3DMM.zip

Requirements:
You just need .Net Framework 4.0 and some 3dmm files to play with.
You shouldn't even need to have 3DMM installed for the decompressions to work; those are built-in.

Annnnnnd of course, this project wouldn't be nearly as cool without Foone. His website (foone.org) has helped tremendously in writing all the decoder stuff.
Some old source code I received years ago courtesy of Frankie has also been quite helpful. Big thanks to both of these individuals for inspiring me to do the code.

Jayrod · 02-26-2016, 05:07 PM

* BUMP *

New features are up top. I'll be continuing my work on this project but while I'm at it it'd be great if you guys gave me feedback or ideas that you would like to see in a 3DMM tool. My end goal is to make an all-in-oner, the ultimate modding doodad for 3DMM.

Foone · 02-26-2016, 05:09 PM

Cool! I haven't had a chance to look at it yet, but it's always good to see more utilities for 3dmm.

One question: How are you doing the decompression if it works without 3dmm being installed?

Also, any plans to release source?

Jayrod · 02-26-2016, 05:36 PM

What I did for the decompression is, in a nutshell, I injected the functions straight from the binary as an array of bytes. That would have been a pain in the arse to write, but I discovered the beauty of turning a byte array into a base64 string and back again.

Basically, I have the base64 strings (they hold the binary of the functions but in string form) defined as constants within a static helper class. At runtime, the base64 is converted to the original byte arrays and then after calling VirtualAlloc and Marshaling the pointer to a delegate method, they work! I used the same technique for the default 3DMM palette, the GLCR section is a constant base64.

I will most certainly share the source eventually, gives me reason to go back in my code and add COMMENTS. I would really like to try my hand at GitHub too. The only thing stopping me from using it is my sloooow internet.

Foone · 02-26-2016, 06:33 PM

Ahh. That's somewhat similar to how DecompProxy works (that 3dmm Pencil/7gen uses)

It just does the pulling of the functions at runtime so I don't have to redistribute microsoft copyrighted binaries.

Jayrod · 02-26-2016, 06:50 PM

DecompProxy DLL is precisely where I got all my information.

French Fry · 02-26-2016, 08:55 PM

What license btw?

Jayrod · 02-29-2016, 12:44 AM

GNU General Public License.

Phil Williamson · 02-29-2016, 06:47 AM

if only you'd released this when Cal Flavell was still around

Jayrod · 12:54 AM

Coming soon:

Foone · 03-01-2016, 01:47 AM

sweet. I have a todo to write some of that code (for expansion previewing, 7gen feedback, etc) so I can't wait to see that.

Jayrod · 03-01-2016, 01:56 AM

Lots of backward tree climbing at the moment to find the textures and bmdls and such. It reloads the whole actor each time you select an animation; I'm going to make it TMPL-context aware before I release it so that it isn't reloading everything unnecessarily like it's doing now. Also coming up in the near future I will be renaming this project and implementing some 3DMM Pencil inspired functionality. The new name and icon may or may not have something to do with "pencil".

Broken Pencil · 03-01-2016, 02:07 AM

You should try to implement this into the next version of 7Gen for previewing (Have it show the texture after conversion, or if the model works properly). I know it won't be easy to code, so I'll go easy on the suggestions. Great job, Jayrod! Some more suggestions:

-Add sound and music playback
-Have the option to disable multiple selection
-And spinning BMDLs

Jayrod · 03-01-2016, 02:29 AM

I have a dummy version that has wave-play capability similar to Pencil (it plays the bytes from memory). I'll have to find some reference for MIDS sections, so I can add play support / extraction.

The interface will hopefully get a cleaner look this next installment, a traditional listview as seen in Pencil with filtering perhaps. Keep the suggestions coming, they may not all make it in but I certainly don't mind receiving them.

BiznessMan · 03-01-2016, 07:04 PM

This is an awesome start to what looks like an awesome piece of software!

I am looking to get back into .net programming (and hopefully a career change) and things like this are inspiring. I wish I could even do something as simple as loading the textures from the 3dmm files and displaying them. Maybe I should get visual studio and get my shit together

Trooper · 03-01-2016, 07:44 PM

Sweet. I didn't know you were back, Jayrod. Awesome work

Dustin Guest · 03-01-2016, 09:34 PM

This is fucking awesome. I need to DL this when I get home.

Jayrod · 03-02-2016, 09:29 AM

* BUMP *

Major Release v2.0 has arrived, see first post.

Holmstrom · 03-02-2016, 10:02 AM

played around with it a bit. this is amazing dude

Jayrod · 03-02-2016, 11:03 AM

Good to hear. I've noticed a problem myself with switching between files, which causes a notification to appear (Supposed to appear when something is ACTUALLY wrong with your file and wouldn't work in 3DMM). It continues to work happily after you close the message. Minor bug but I'll fix it.

Broken Pencil · 03-02-2016, 01:28 PM

Oh my goodness.

Liam Brocklehurst · 03-02-2016, 01:38 PM

This is some cool stuff, dude!

Jayrod · 03-02-2016, 01:46 PM

@Broken Pencil Yeahhhh the UVs are finicky in some instances. Funny, the default Ramu character has mapping problems in the face as well. That screenshot is really cool to see, glad everything works for you guys. Well, for the most part!

Dustin Guest · 03-02-2016, 02:14 PM

Man, I got to play around with this last night. Some models I thought were going to be lost to me forever were salvaged because of this. Seriously amazing work.

Jayrod · 03-02-2016, 02:29 PM

I'm really pumped to hear about that Dustin. That's wonderful!

02-25-2016, 11:59 AM	#1
Jayrod Super Moderator Join Date: Aug 2008 Posts: 615	[Utility] Chunk Extractor v2.0.0.1 v2.0.0.1 Tiny update: Finally decoded TXXF properly. UVs should* be correct now in all instances. Give me a shout if you spot any problems.* * If you don't have a 3DMM file handy, I have provided a link for you. Check the bottom of this post. * Release Notes Chunk Extractor is evolving into a bigger program. Unfortunately, some features have been lost since the previous rendition due to constant rewriting. I have included the download link for the previous version down below, should you like to use it until more features arrive. What's new: Added a toggle between standard and grouped list (standard being what you're used to if you use Frankie's 3DMM Pencil++) BMDLs no longer spin. You can adjust the camera yourself. Full body Actor / Prop preview with features including: Rotatable / zoomable viewport. Animated figure (Actions) Costume-able figure. Chunk Explorer v2.0.0.0: Chunk Extractor v1.0.1.0 Download the latest software (v2.0.0.1): http://liambrocklehurst.com/uploader...r-v2.0.0.1.zip Download Chunk Extractor v1.0.1.0: http://liambrocklehurst.com/uploader...t_v1.0.1.0.zip Other Downloads: Broken Pencil's MEGA Folder ^ Older versions of the program among other things can be found here. If you don't have a 3DMM file handy and you want to try this out, grab the original Patrick from: http://liambrocklehurst.com/uploader...atrick3DMM.zip Requirements: You just need .Net Framework 4.0 and some 3dmm files to play with. You shouldn't even need to have 3DMM installed for the decompressions to work; those are built-in. Annnnnnd of course, this project wouldn't be nearly as cool without Foone. His website (foone.org) has helped tremendously in writing all the decoder stuff. Some old source code I received years ago courtesy of Frankie has also been quite helpful. Big thanks to both of these individuals for inspiring me to do the code.
Jayrod Super Moderator Join Date: Aug 2008 Posts: 615	Last edited by Jayrod : 04-10-2016 at 12:48 AM. Reason: Replaced images with thumb tags

02-26-2016, 05:07 PM	#2
Jayrod Super Moderator Join Date: Aug 2008 Posts: 615	Version 1.0.1.0 released * BUMP * New features are up top. I'll be continuing my work on this project but while I'm at it it'd be great if you guys gave me feedback or ideas that you would like to see in a 3DMM tool. My end goal is to make an all-in-oner, the ultimate modding doodad for 3DMM.
Jayrod Super Moderator Join Date: Aug 2008 Posts: 615

02-26-2016, 05:09 PM	#3
Foone Member Join Date: May 2013 Posts: 631	Cool! I haven't had a chance to look at it yet, but it's always good to see more utilities for 3dmm. One question: How are you doing the decompression if it works without 3dmm being installed? Also, any plans to release source?
Foone Member Join Date: May 2013 Posts: 631

02-26-2016, 05:36 PM	#4
Jayrod Super Moderator Join Date: Aug 2008 Posts: 615	What I did for the decompression is, in a nutshell, I injected the functions straight from the binary as an array of bytes. That would have been a pain in the arse to write, but I discovered the beauty of turning a byte array into a base64 string and back again. Basically, I have the base64 strings (they hold the binary of the functions but in string form) defined as constants within a static helper class. At runtime, the base64 is converted to the original byte arrays and then after calling VirtualAlloc and Marshaling the pointer to a delegate method, they work! I used the same technique for the default 3DMM palette, the GLCR section is a constant base64. I will most certainly share the source eventually, gives me reason to go back in my code and add COMMENTS. I would really like to try my hand at GitHub too. The only thing stopping me from using it is my sloooow internet.
Jayrod Super Moderator Join Date: Aug 2008 Posts: 615

02-26-2016, 06:33 PM	#5
Foone Member Join Date: May 2013 Posts: 631	Ahh. That's somewhat similar to how DecompProxy works (that 3dmm Pencil/7gen uses) It just does the pulling of the functions at runtime so I don't have to redistribute microsoft copyrighted binaries.
Foone Member Join Date: May 2013 Posts: 631

02-26-2016, 06:50 PM	#6
Jayrod Super Moderator Join Date: Aug 2008 Posts: 615	DecompProxy DLL is precisely where I got all my information.
Jayrod Super Moderator Join Date: Aug 2008 Posts: 615

02-26-2016, 08:55 PM	#7
French Fry Super Moderator Join Date: Dec 2013 Posts: 1,962	What license btw?

02-29-2016, 12:44 AM	#8
Jayrod Super Moderator Join Date: Aug 2008 Posts: 615	GNU General Public License.
Jayrod Super Moderator Join Date: Aug 2008 Posts: 615

02-29-2016, 06:47 AM	#9
Phil Williamson Super Moderator Join Date: Oct 2002 Posts: 16,900	if only you'd released this when Cal Flavell was still around

03-01-2016, 01:42 AM	#10
Jayrod Super Moderator Join Date: Aug 2008 Posts: 615	Coming soon:
Jayrod Super Moderator Join Date: Aug 2008 Posts: 615	Last edited by Jayrod : 04-10-2016 at 12:54 AM. Reason: Replaced image with thumb tag

03-01-2016, 01:47 AM	#11
Foone Member Join Date: May 2013 Posts: 631	sweet. I have a todo to write some of that code (for expansion previewing, 7gen feedback, etc) so I can't wait to see that.
Foone Member Join Date: May 2013 Posts: 631

03-01-2016, 01:56 AM	#12
Jayrod Super Moderator Join Date: Aug 2008 Posts: 615	Lots of backward tree climbing at the moment to find the textures and bmdls and such. It reloads the whole actor each time you select an animation; I'm going to make it TMPL-context aware before I release it so that it isn't reloading everything unnecessarily like it's doing now. Also coming up in the near future I will be renaming this project and implementing some 3DMM Pencil inspired functionality. The new name and icon may or may not have something to do with "pencil".
Jayrod Super Moderator Join Date: Aug 2008 Posts: 615

03-01-2016, 02:07 AM	#13
Broken Pencil Senior Member Join Date: Sep 2013 Posts: 2,341	You should try to implement this into the next version of 7Gen for previewing (Have it show the texture after conversion, or if the model works properly). I know it won't be easy to code, so I'll go easy on the suggestions. Great job, Jayrod! Some more suggestions: -Add sound and music playback -Have the option to disable multiple selection -And spinning BMDLs

03-01-2016, 02:29 AM	#14
Jayrod Super Moderator Join Date: Aug 2008 Posts: 615	I have a dummy version that has wave-play capability similar to Pencil (it plays the bytes from memory). I'll have to find some reference for MIDS sections, so I can add play support / extraction. The interface will hopefully get a cleaner look this next installment, a traditional listview as seen in Pencil with filtering perhaps. Keep the suggestions coming, they may not all make it in but I certainly don't mind receiving them.
Jayrod Super Moderator Join Date: Aug 2008 Posts: 615

03-01-2016, 07:04 PM	#15
BiznessMan Junior Member Join Date: Jul 2012 Posts: 143	This is an awesome start to what looks like an awesome piece of software! I am looking to get back into .net programming (and hopefully a career change) and things like this are inspiring. I wish I could even do something as simple as loading the textures from the 3dmm files and displaying them. Maybe I should get visual studio and get my shit together
BiznessMan Junior Member Join Date: Jul 2012 Posts: 143

03-01-2016, 07:44 PM	#16
Trooper Senior Member Join Date: Mar 2007 Posts: 7,441	Sweet. I didn't know you were back, Jayrod. Awesome work
Trooper Senior Member Join Date: Mar 2007 Posts: 7,441

03-01-2016, 09:34 PM	#17
Dustin Guest Senior Member Join Date: Oct 2001 Posts: 4,420	This is fucking awesome. I need to DL this when I get home.

03-02-2016, 09:29 AM	#18
Jayrod Super Moderator Join Date: Aug 2008 Posts: 615	* BUMP * Major Release v2.0 has arrived, see first post.
Jayrod Super Moderator Join Date: Aug 2008 Posts: 615

03-02-2016, 10:02 AM	#19
Holmstrom Junior Member Join Date: Oct 2007 Posts: 112	played around with it a bit. this is amazing dude
Holmstrom Junior Member Join Date: Oct 2007 Posts: 112

03-02-2016, 11:03 AM	#20
Jayrod Super Moderator Join Date: Aug 2008 Posts: 615	Good to hear. I've noticed a problem myself with switching between files, which causes a notification to appear (Supposed to appear when something is ACTUALLY wrong with your file and wouldn't work in 3DMM). It continues to work happily after you close the message. Minor bug but I'll fix it.
Jayrod Super Moderator Join Date: Aug 2008 Posts: 615

03-02-2016, 01:28 PM	#21
Broken Pencil Senior Member Join Date: Sep 2013 Posts: 2,341	Oh my goodness.

03-02-2016, 01:38 PM	#22
Liam Brocklehurst Senior Member Join Date: Apr 2007 Posts: 4,143	This is some cool stuff, dude!

03-02-2016, 01:46 PM	#23
Jayrod Super Moderator Join Date: Aug 2008 Posts: 615	@Broken Pencil Yeahhhh the UVs are finicky in some instances. Funny, the default Ramu character has mapping problems in the face as well. That screenshot is really cool to see, glad everything works for you guys. Well, for the most part!
Jayrod Super Moderator Join Date: Aug 2008 Posts: 615

03-02-2016, 02:14 PM	#24
Dustin Guest Senior Member Join Date: Oct 2001 Posts: 4,420	Man, I got to play around with this last night. Some models I thought were going to be lost to me forever were salvaged because of this. Seriously amazing work.

03-02-2016, 02:29 PM	#25
Jayrod Super Moderator Join Date: Aug 2008 Posts: 615	I'm really pumped to hear about that Dustin. That's wonderful!
Jayrod Super Moderator Join Date: Aug 2008 Posts: 615