Ripping/encoding/releasing Q & A Prt. II
Author |
Message |
telmoMRC
Pito
Joined: Tue Aug 21, 2007 8:24 pm Posts: 9517 Location: Near The Shity Friends
|
Re: Ripping/encoding/releasing Q & A Prt. II
i try another way but never work now said this direct show source could not open as video or audio bla bla bla ......
_________________
|
Tue Nov 25, 2008 4:06 pm |
|
|
elguaxo
End of Level Boss
Joined: Fri Mar 16, 2007 5:10 pm Posts: 7535
|
Re: Ripping/encoding/releasing Q & A Prt. II
Directshow is not for opening a .DGA file. In fact you should never use directshow for encoding because it's not frame accurate, the only exception is using it via GraphEdit.
Have you used DGAVCDec to create the DGA file? What options have you used.
Have you read the DGAVCDec manual at all?
_________________ Old2New SBiG URL Replacement Script | SBiG searchplugin my AviSynth Plugins folder | Show Just Image 2 | Doom10
|
Tue Nov 25, 2008 4:18 pm |
|
|
telmoMRC
Pito
Joined: Tue Aug 21, 2007 8:24 pm Posts: 9517 Location: Near The Shity Friends
|
Re: Ripping/encoding/releasing Q & A Prt. II
elguaxo wrote: Have you used DGAVCDec to create the DGA file? What options have you used.
Have you read the DGAVCDec manual at all?
yes i use DGAVCDec to create the DGA file that is easy is like dgindex no problem in this the options i select only honor pulldow flags and audio demux nothing more and yes i read the manual but my english is not that good i understand some things but outhers
_________________
|
Tue Nov 25, 2008 5:07 pm |
|
|
telmoMRC
Pito
Joined: Tue Aug 21, 2007 8:24 pm Posts: 9517 Location: Near The Shity Friends
|
Re: Ripping/encoding/releasing Q & A Prt. II
my path AVCSource("C:\Documents and Settings\Administrator\My Documents\fight\ - this is where the file are Fight.Club.1999_Track1.h264 - was extract whit MKVextractGUI \xzpto.dga") - this was dga file it seems to be ok
_________________
|
Tue Nov 25, 2008 5:11 pm |
|
|
telmoMRC
Pito
Joined: Tue Aug 21, 2007 8:24 pm Posts: 9517 Location: Near The Shity Friends
|
Re: Ripping/encoding/releasing Q & A Prt. II
_________________
|
Tue Nov 25, 2008 6:21 pm |
|
|
elchupacabra
Tittietantalized
Joined: Wed May 21, 2008 7:56 pm Posts: 627
|
Re: Ripping/encoding/releasing Q & A Prt. II
I'll post this here, because it is of interest for everybody encoding on a multicore CPU. Simple/normal encoding procedure on my quadcore CPU: Result: Multithreaded encoding using all 4 cores: Result: I can't tell the real speedup, because I haven't started the encoding yet. But I can tell you that it is definitely faster. The key is the multithreaded AviSynth version: http://avisynth.org/mediawiki/MT_support_page But you have to be carefull, because some filters crash or producre bad results if you split the frames up. Sometimes even overlapping the frame edges won't help. Thanks goto elguaxo for pointing me into the right direction. :beerchug: Almost forgot the AviSynth script: Code: # Number of threads for multithreaded encoding (= number of cores) mt_count = 4
# PLUGINS LoadPlugin("E:\MyProgies\Ripping\GordianKnot\AviSynthPlugins\MaskTools.dll") LoadPlugin("E:\MyProgies\Ripping\GordianKnot\AviSynthPlugins\Repair.dll") LoadPlugin("E:\MyProgies\Ripping\GordianKnot\AviSynthPlugins\RemoveGrain.dll") LoadPlugin("E:\MyProgies\Ripping\GordianKnot\AviSynthPlugins\FFT3DFilter.dll") LoadPlugin("E:\MyProgies\Ripping\GordianKnot\AviSynthPlugins\mvtools\mvtools.dll") LoadPlugin("E:\MyProgies\Ripping\GordianKnot\AviSynthPlugins\ChromaShift.dll") LoadPlugin("E:\MyProgies\Ripping\GordianKnot\AviSynthPlugins\VInverse.dll") LoadPlugin("E:\MyProgies\Ripping\GordianKnot\AviSynthPlugins\gradfun2db.dll") LoadPlugin("E:\MyProgies\Ripping\GordianKnot\AviSynthPlugins\mt_masktools-26.dll") LoadPlugin("E:\MyProgies\Ripping\GordianKnot\AviSynthPlugins\TTempSmooth.dll") LoadPlugin("E:\MyProgies\Ripping\GordianKnot\AviSynthPlugins\AddGrainC.dll") LoadPlugin("E:\MyProgies\Ripping\GordianKnot\AviSynthPlugins\Cnr2.dll") LoadPlugin("E:\MyProgies\Ripping\GordianKnot\AviSynthPlugins\TIVTC.dll")
# IMPORT Import("E:\MyProgies\Ripping\GordianKnot\AviSynthIncludes\MCTemporalDenoise.v1.0beta2.avsi") Import("E:\MyProgies\Ripping\GordianKnot\AviSynthIncludes\LimitedSharpenFaster.avsi") Import("E:\MyProgies\Ripping\GordianKnot\AviSynthIncludes\GrainFactory3.avsi") Import("E:\MyProgies\Ripping\GordianKnot\AviSynthIncludes\FixChromaBleeding.avsi")
# Load AVI source clip AviSource("J:\Ripping\MasqueOfTheRedDeath-1989\capture.avi", true, "RGB24", fourCC="HFYU")
# IVTC ConvertToYV12() tfm(pp=7, cthresh=8, chroma=true).tdecimate() Vinverse()
# Shift chroma info left by 2 pixels MT("ChromaShift(C=-2)", mt_count, 2)
# DENOISING MT("FFT3DFilter(sigma=3,plane=3,bt=5)", mt_count, 24) MT("FixChromaBleeding()", mt_count, 16) # Fix color bleeding MCTemporalDenoise(settings="medium",chroma=true,stabilize=true,GPU=false) MT("""Cnr2("xxx", 4, 5, 255)""", mt_count, 24) # Remove chroma noise
# Trimming & Cropping crop(0, 6, -4, -0) MT("Spline36Resize(512, last.height)", mt_count) MT("Spline36Resize(last.width, 384)", mt_count, splitvertical=true)
# Correct Basic Video settings MT("""ColorYUV(off_y=-15, gain_y=+22, cont_v=-12.8, cont_u=-51.2, opt="coring")""", mt_count) MT("Tweak(bright=0, cont=1, hue=+4.5, sat=0.95, coring=false)", mt_count)
# Add grain MT("GrainFactory3(g1str=4, g2str=5, g3str=16, g1shrp=30, g2shrp=40, g3shrp=50)", mt_count, 24) MT("FadeIO2(180)", mt_count)
_________________
|
Tue Nov 25, 2008 8:46 pm |
|
|
elguaxo
End of Level Boss
Joined: Fri Mar 16, 2007 5:10 pm Posts: 7535
|
Re: Ripping/encoding/releasing Q & A Prt. II
elchupacabra wrote: LoadPlugin("E:\MyProgies\Ripping\GordianKnot\AviSynthPlugins\mvtools\mvtools.dll")
...
LoadPlugin("E:\MyProgies\Ripping\GordianKnot\AviSynthPlugins\mt_masktools-26.dll") [/code] you're still using the wrong version of masktools: viewtopic.php?f=31&t=1189&p=115376#p115376there is also a native multithreaded version of mvtools and MCTemporalDenoise can use it. Under some circumstances it's a bit unstable, but the speed is great. Since the slowest part of your script is mvtools/MCTemporalDenoise, you could try the multithreaded version.
_________________ Old2New SBiG URL Replacement Script | SBiG searchplugin my AviSynth Plugins folder | Show Just Image 2 | Doom10
|
Tue Nov 25, 2008 8:58 pm |
|
|
elchupacabra
Tittietantalized
Joined: Wed May 21, 2008 7:56 pm Posts: 627
|
Re: Ripping/encoding/releasing Q & A Prt. II
I forgot about that one. Thanks for pointing it out again. elguaxo wrote: - Xvid does not scale very well among multiple cores. There's is nothing you can do about it. This might be what I am experiencing now. I started the encoding and there is no speedup. The preview was a lot faster in VirtualDubMod, but the encoding to XviD is still the same. But I don't understand what this has to do with the codec.
_________________
|
Tue Nov 25, 2008 9:05 pm |
|
|
elguaxo
End of Level Boss
Joined: Fri Mar 16, 2007 5:10 pm Posts: 7535
|
Re: Ripping/encoding/releasing Q & A Prt. II
The codec itself requires a lot of CPU during encoding. Avisynth loads and filters the video and after that the codec does everything else. In real life almost all multithreaded apps, like Xvid itself, are not optimized to take full advantage of all cores and the problem is bigger the more cores you have.
You have now a VERY slow script. Avisynth MT helps a bit using all cores, but it's still not perfect, and Xvid doesn't do a god job either -> it will be hard/impossible to max out all 4 cores.
As I said in my earlier post, the slowest part is mvtools/MCTemporalDenoise. Try optimizing that part using the multithreaded version of mvtools/MCTemporalDenoise.
_________________ Old2New SBiG URL Replacement Script | SBiG searchplugin my AviSynth Plugins folder | Show Just Image 2 | Doom10
|
Tue Nov 25, 2008 9:17 pm |
|
|
elchupacabra
Tittietantalized
Joined: Wed May 21, 2008 7:56 pm Posts: 627
|
Re: Ripping/encoding/releasing Q & A Prt. II
elguaxo wrote: There is also a native multithreaded version of mvtools and MCTemporalDenoise can use it. Under some circumstances it's a bit unstable, but the speed is great. Since the slowest part of your script is mvtools/MCTemporalDenoise, you could try the multithreaded version. MCTemporalDenoise works with MT without any problem for me. The only problem is that if I use it, the quality of the output is bad. Overlapping the edges won't help.
_________________
|
Tue Nov 25, 2008 9:20 pm |
|
|
elchupacabra
Tittietantalized
Joined: Wed May 21, 2008 7:56 pm Posts: 627
|
Re: Ripping/encoding/releasing Q & A Prt. II
elguaxo wrote: The codec itself requires a lot of CPU during encoding. Avisynth loads and filters the video and after that the codec does everything else. Yes, but AviSynth uses all cores and calls the filters: If you replace VirtualDub with the XviD codec, there is no clear reason why it shouldn't work, is there?
_________________
|
Tue Nov 25, 2008 9:23 pm |
|
|
elguaxo
End of Level Boss
Joined: Fri Mar 16, 2007 5:10 pm Posts: 7535
|
Re: Ripping/encoding/releasing Q & A Prt. II
Yep. The difference shouldn't be so drastic. What version of Xvid are you using?
_________________ Old2New SBiG URL Replacement Script | SBiG searchplugin my AviSynth Plugins folder | Show Just Image 2 | Doom10
|
Tue Nov 25, 2008 9:25 pm |
|
|
elchupacabra
Tittietantalized
Joined: Wed May 21, 2008 7:56 pm Posts: 627
|
Re: Ripping/encoding/releasing Q & A Prt. II
elguaxo wrote: Yep. The difference shouldn't be so drastic. What version of Xvid are you using? It's version 1.1.3
_________________
|
Tue Nov 25, 2008 9:53 pm |
|
|
elguaxo
End of Level Boss
Joined: Fri Mar 16, 2007 5:10 pm Posts: 7535
|
Re: Ripping/encoding/releasing Q & A Prt. II
heh. That version is single threaded. Use 1.2.
_________________ Old2New SBiG URL Replacement Script | SBiG searchplugin my AviSynth Plugins folder | Show Just Image 2 | Doom10
|
Tue Nov 25, 2008 9:58 pm |
|
|
elchupacabra
Tittietantalized
Joined: Wed May 21, 2008 7:56 pm Posts: 627
|
Re: Ripping/encoding/releasing Q & A Prt. II
elguaxo wrote: heh. That version is single threaded. Use 1.2. See that is what I don't get. What does XviD have to do with the threads? I thought that 1.1.3 is the latest XviD release.
_________________
|
Tue Nov 25, 2008 10:50 pm |
|
|
elguaxo
End of Level Boss
Joined: Fri Mar 16, 2007 5:10 pm Posts: 7535
|
Re: Ripping/encoding/releasing Q & A Prt. II
http://www.koepi.info/XviD-1.2.-127-VAQ.exe edit: some patches have been applied in the meantime, but I think it's basically 2 or more years old already.
_________________ Old2New SBiG URL Replacement Script | SBiG searchplugin my AviSynth Plugins folder | Show Just Image 2 | Doom10
|
Tue Nov 25, 2008 11:40 pm |
|
|
elchupacabra
Tittietantalized
Joined: Wed May 21, 2008 7:56 pm Posts: 627
|
Re: Ripping/encoding/releasing Q & A Prt. II
elguaxo wrote: http://www.koepi.info/XviD-1.2.-127-VAQ.exe edit: some patches have been applied in the meantime, but I think it's basically 2 or more years old already. Thanks. I already found it with Google. We'll see how this one behaves.
_________________
|
Wed Nov 26, 2008 6:59 pm |
|
|
elchupacabra
Tittietantalized
Joined: Wed May 21, 2008 7:56 pm Posts: 627
|
Re: Ripping/encoding/releasing Q & A Prt. II
AviSynth wiki wrote: Since rev 0.5, MT() internally calls SetMTMode(5) and restores the old mode afterwards so you don't have to add SetMTMode(5) before MT() and restore the old mode after tsp author of MT wrote: setmtmode(5) disables multithreading for the filters below it. WTF?
_________________
|
Wed Nov 26, 2008 11:24 pm |
|
|
elchupacabra
Tittietantalized
Joined: Wed May 21, 2008 7:56 pm Posts: 627
|
Re: Ripping/encoding/releasing Q & A Prt. II
elchupacabra wrote: Multithreaded encoding using all 4 cores: This is ridiculous. I can't reproduce this CPU usage. Everytime I start an XviD encoding or preview with VirtualDubMod I get a CPU usage of around 25%. I tired encoding with x264 (threads=0=auto=1,5*4=6), which results in almost 100% CPU usage and a faster encoding than XviD! But for some reason this has to do with MeGUI. If I look at the thread count of MeGUI after starting an XviD encoding, it only gets increased by 2 and not by the number of threads you enter. This could be a bug and the whole textfield seems like a placebo to me.
_________________
|
Wed Nov 26, 2008 11:57 pm |
|
|
telmoMRC
Pito
Joined: Tue Aug 21, 2007 8:24 pm Posts: 9517 Location: Near The Shity Friends
|
Re: Ripping/encoding/releasing Q & A Prt. II
now give it this error but i have that file what is the problem ???
_________________
|
Thu Nov 27, 2008 12:28 am |
|
|
elguaxo
End of Level Boss
Joined: Fri Mar 16, 2007 5:10 pm Posts: 7535
|
Re: Ripping/encoding/releasing Q & A Prt. II
Are you still using XP 64?
_________________ Old2New SBiG URL Replacement Script | SBiG searchplugin my AviSynth Plugins folder | Show Just Image 2 | Doom10
|
Thu Nov 27, 2008 12:32 am |
|
|
telmoMRC
Pito
Joined: Tue Aug 21, 2007 8:24 pm Posts: 9517 Location: Near The Shity Friends
|
Re: Ripping/encoding/releasing Q & A Prt. II
yes
_________________
|
Thu Nov 27, 2008 12:34 am |
|
|
elguaxo
End of Level Boss
Joined: Fri Mar 16, 2007 5:10 pm Posts: 7535
|
Re: Ripping/encoding/releasing Q & A Prt. II
_________________ Old2New SBiG URL Replacement Script | SBiG searchplugin my AviSynth Plugins folder | Show Just Image 2 | Doom10
|
Thu Nov 27, 2008 12:36 am |
|
|
telmoMRC
Pito
Joined: Tue Aug 21, 2007 8:24 pm Posts: 9517 Location: Near The Shity Friends
|
Re: Ripping/encoding/releasing Q & A Prt. II
_________________
|
Thu Nov 27, 2008 12:38 am |
|
|
elguaxo
End of Level Boss
Joined: Fri Mar 16, 2007 5:10 pm Posts: 7535
|
Re: Ripping/encoding/releasing Q & A Prt. II
_________________ Old2New SBiG URL Replacement Script | SBiG searchplugin my AviSynth Plugins folder | Show Just Image 2 | Doom10
|
Thu Nov 27, 2008 12:40 am |
|
|
telmoMRC
Pito
Joined: Tue Aug 21, 2007 8:24 pm Posts: 9517 Location: Near The Shity Friends
|
Re: Ripping/encoding/releasing Q & A Prt. II
not today i am in that time of the mount iu hope you understand i am fuck is that it ??
_________________
|
Thu Nov 27, 2008 12:45 am |
|
|
elguaxo
End of Level Boss
Joined: Fri Mar 16, 2007 5:10 pm Posts: 7535
|
Re: Ripping/encoding/releasing Q & A Prt. II
elchupacabra wrote: for some reason this has to do with MeGUI MeGUI is just a GUI for a bunch of commandline programs, don't forget that. Try encoding directly from the commandline like the real men do and see how many threads work best for you. encraw passes the amount of required threads to the xvidcore.dll via the -threads parameter. If it doesn't work, try the encraw thread: http://forum.doom9.org/showthread.php?t=98469and read the Multithreaded XviD thread: http://forum.doom9.org/showthread.php?t=107783One of my PCs has 2 cores, but I use it only for x264 encoding, so I have no experience multithreading Xvid.
_________________ Old2New SBiG URL Replacement Script | SBiG searchplugin my AviSynth Plugins folder | Show Just Image 2 | Doom10
|
Thu Nov 27, 2008 12:56 am |
|
|
telmoMRC
Pito
Joined: Tue Aug 21, 2007 8:24 pm Posts: 9517 Location: Near The Shity Friends
|
Re: Ripping/encoding/releasing Q & A Prt. II
only shit is working i think some sources do not work propely so gx your request is in good way proudly presents mamamia for gx filter not filter by the way should i put some code for crop or leave it this way ?? the source is touched AVCSource("C:\Documents and Settings\Administrator\My Documents\mamamia\Mam.dga")
#crop(38,90,656,396)
Spline36Resize(720,304)
a = last b=a.DeGrainMedian( mode=4) SeeSaw(a,b,NRlimit=3, NRlimit2=4, Sstr=1.5, Slimit=4, Spower=3, Sdamplo=5, Szp=11) |
_________________
|
Thu Nov 27, 2008 1:35 am |
|
|
elguaxo
End of Level Boss
Joined: Fri Mar 16, 2007 5:10 pm Posts: 7535
|
Re: Ripping/encoding/releasing Q & A Prt. II
looks fine!
_________________ Old2New SBiG URL Replacement Script | SBiG searchplugin my AviSynth Plugins folder | Show Just Image 2 | Doom10
|
Thu Nov 27, 2008 1:44 am |
|
|
elchupacabra
Tittietantalized
Joined: Wed May 21, 2008 7:56 pm Posts: 627
|
Re: Ripping/encoding/releasing Q & A Prt. II
telmoMRC wrote: by the way should i put some code for crop or leave it this way ?? I don't see a reason to crop.
_________________
|
Thu Nov 27, 2008 10:20 am |
|
|
|