So Bad It's Good
Register • FAQ • Search • Login
It is currently Sat Apr 27, 2024 8:10 am

View unanswered posts | View active topics


Board index » Help and Development » FAQ / Newbie - the starting point

All times are UTC + 1 hour [ DST ]



Post new topic This topic is locked, you cannot edit posts or make further replies.  Page 5 of 126
  [ 3754 posts ]  Go to page Previous  1, 2, 3, 4, 5, 6, 7, 8 ... 126  Next
Print view Previous topic | Next topic 
 Ripping/encoding/releasing Q & A Prt. II 
Author Message
elchupacabra
Tittietantalized
Tittietantalized
User avatar

Joined: Wed May 21, 2008 7:56 pm
Posts: 627
Post Re: Ripping/encoding/releasing Q & A Prt. II
elguaxo wrote:
MeGUI is just a GUI for a bunch of commandline programs, don't forget that. Try encoding directly from the commandline like the real men do and see how many threads work best for you. encraw passes the amount of required threads to the xvidcore.dll via the -threads parameter.

If it doesn't work, try the encraw thread: http://forum.doom9.org/showthread.php?t=98469
and read the Multithreaded XviD thread: http://forum.doom9.org/showthread.php?t=107783

One of my PCs has 2 cores, but I use it only for x264 encoding, so I have no experience multithreading Xvid.


Can you verify my following thoughts?

AviSynth multithreading has basically nothing to do with multithreading XviD or x264.

You can do one of the following 4:

1.) NO Avisynth MT + NO XviD MT (standard encoding)
2.) Avisynth MT + NO XviD MT
3.) NO Avisynth MT + XviD MT
4.) Avisynth MT + XviD MT

NO Avisynth MT + XviD MT is basically the same as using Avisynth MT + NO XviD MT with SetMTMode() in AviSynth, because they both result in temporal multithreading.

AviSynth MT + XviD MT is quite nonsense, because it uses multiple threads for creating XviD frames whereas every XviD thread in addition is split up into another threads at the level of AviSynth. :crazy2:

_________________
elguaxo wrote:
x264 encoding guide: viewtopic.php?f=43&t=16224

Thu Nov 27, 2008 12:47 pm
Profile
elguaxo
End of Level Boss
End of Level Boss
User avatar

Joined: Fri Mar 16, 2007 5:10 pm
Posts: 7535
Post Re: Ripping/encoding/releasing Q & A Prt. II
I don't know :lol:

I do know that I get the max speed with a multithreaded Avisynth script + multithreaded x264. A simplethreaded Avisynth script (specially using heavy stuff like mvtools) + multithreaded x264 is definitively slower. That's a fact.

_________________
Old2New SBiG URL Replacement Script | SBiG searchplugin
my AviSynth Plugins folder | Show Just Image 2 | Doom10

Thu Nov 27, 2008 1:07 pm
Profile
elchupacabra
Tittietantalized
Tittietantalized
User avatar

Joined: Wed May 21, 2008 7:56 pm
Posts: 627
Post Re: Ripping/encoding/releasing Q & A Prt. II
Alright. :D

I belive it goes like this (until proven otherwise):

1.) AviSynth creates the frame (maybe using MT or SetMTmode multithreaded)
2.) XviD/x264 compresses the resulting frame (maybe using multiple threads, but this only speeds up the work of the codec)

So the most speedup is gained using multithreading at level 1 for XviD and since x264 is a more complex (and thus slower to encode with) codec maybe also multithreading at level 2 add some speedup for x264.

Edit: I found the problem. You have to call SetMTMode() as the very first function in your AVS. :roll: Otherwise multithreading does not work.

_________________
elguaxo wrote:
x264 encoding guide: viewtopic.php?f=43&t=16224

Thu Nov 27, 2008 7:40 pm
Profile
Pure
Veggie Fridge
Veggie Fridge
User avatar

Joined: Fri Mar 24, 2006 2:59 pm
Posts: 21656
Location: Fuck You! GoodBye!
Post Re: Ripping/encoding/releasing Q & A Prt. II
So it all came down to SetMTMode() ?

:cool:
Thu Nov 27, 2008 10:36 pm
Profile
elchupacabra
Tittietantalized
Tittietantalized
User avatar

Joined: Wed May 21, 2008 7:56 pm
Posts: 627
Post Re: Ripping/encoding/releasing Q & A Prt. II
Pure wrote:
So it all came down to SetMTMode() ?


You have to call SetMTMode at the very beginning of your script, even if you are only using MT.

However encoding to XviD has very little speedup (~ 10%). While encoding I can see that all cores are used now, but in sum CPU usage is only around 33%. Without MT, CPU usage is 25%.

When encoding to x264 and using MT, CPU usage goes up to sometimes 100%. Which is perfect.

_________________
elguaxo wrote:
x264 encoding guide: viewtopic.php?f=43&t=16224

Thu Nov 27, 2008 10:46 pm
Profile
Pure
Veggie Fridge
Veggie Fridge
User avatar

Joined: Fri Mar 24, 2006 2:59 pm
Posts: 21656
Location: Fuck You! GoodBye!
Post Re: Ripping/encoding/releasing Q & A Prt. II
Hopefully in februari i'll have a new comp so i'll keep this in mind. Thanks for the info :good:
Did read here (in this thread) and at other sites/forums that XviD speedup wasn't that big but any improvement is more then welcome.

:cheer:
Thu Nov 27, 2008 10:52 pm
Profile
El Mariachi
buttfuckbullfrog
buttfuckbullfrog
User avatar

Joined: Tue Jul 04, 2006 10:35 am
Posts: 10201
Location: On top of a turd
Post Re: Ripping/encoding/releasing Q & A Prt. II
Pure wrote:
Hopefully in februari i'll have a new comp so i'll keep this in mind.


That was my original plan too. Unfortunately, due to Mariachi stupidity, I already got one earlier this week.

_________________
Your offer pleases the TechnoViking :oral:
Image

Fri Nov 28, 2008 10:30 am
Profile
telmoMRC
Pito
Pito
User avatar

Joined: Tue Aug 21, 2007 8:24 pm
Posts: 9517
Location: Near The Shity Friends
Post Re: Ripping/encoding/releasing Q & A Prt. II
batman dvd have 2 AR what can i do to fix that ??? :wha: :wha:

_________________
Image Image Image Image

Fri Nov 28, 2008 2:36 pm
Profile
cuub
Pukake
Pukake
User avatar

Joined: Tue Dec 11, 2007 2:10 am
Posts: 575
Post Re: Ripping/encoding/releasing Q & A Prt. II
In this case you don't. This movie has some scenes in IMAX format. So, to respect the AR who have to leave those scenes with black borders.

_________________
Sync your files online and across computers.
Access your files from any computer.
Collaborate on files with others.
Keep track of every version of your files.

Fri Nov 28, 2008 5:31 pm
Profile
elguaxo
End of Level Boss
End of Level Boss
User avatar

Joined: Fri Mar 16, 2007 5:10 pm
Posts: 7535
Post Re: Ripping/encoding/releasing Q & A Prt. II
If you are going to release it, just write a "note" to explain the black bars. I did it for example here.

_________________
Old2New SBiG URL Replacement Script | SBiG searchplugin
my AviSynth Plugins folder | Show Just Image 2 | Doom10

Fri Nov 28, 2008 5:41 pm
Profile
telmoMRC
Pito
Pito
User avatar

Joined: Tue Aug 21, 2007 8:24 pm
Posts: 9517
Location: Near The Shity Friends
Post Re: Ripping/encoding/releasing Q & A Prt. II
no i will not release i was thinking some script for the imax parts :bang: :bang:

something like that :lol:

_________________
Image Image Image Image

Fri Nov 28, 2008 8:06 pm
Profile
telmoMRC
Pito
Pito
User avatar

Joined: Tue Aug 21, 2007 8:24 pm
Posts: 9517
Location: Near The Shity Friends
Post Re: Ripping/encoding/releasing Q & A Prt. II
was release it this in sft
Taken.2008.BDRip.AC3.XviD-LTRG audio AC3 but the only blu ray rip are release was
Taken 2008 1080p BluRay x264-REFiNED and Taken 2008 720p BluRay x264-REFiNED bouth whit DTS audio :grrr: if the origianl audio is DTS how they convert to AC3 or what they do ??

_________________
Image Image Image Image

Sat Nov 29, 2008 1:25 am
Profile
cuub
Pukake
Pukake
User avatar

Joined: Tue Dec 11, 2007 2:10 am
Posts: 575
Post Re: Ripping/encoding/releasing Q & A Prt. II
I have already answered you in DH...
cuub wrote:
telmoMRC wrote:
e d? para converter o som dts em ac3 ou como ? que os gajos fazem isso ? que muitos rips so tem dts mas depois de ripados ficam com o som ac3

D?. eac3to


How to use? Click me

_________________
Sync your files online and across computers.
Access your files from any computer.
Collaborate on files with others.
Keep track of every version of your files.

Sat Nov 29, 2008 1:38 am
Profile
telmoMRC
Pito
Pito
User avatar

Joined: Tue Aug 21, 2007 8:24 pm
Posts: 9517
Location: Near The Shity Friends
Post Re: Ripping/encoding/releasing Q & A Prt. II
Nao ? estar a duvidar de ti mas podia haver algo mais facil :lol: :lol: outra maneira sei l? :lol: ? que estou farto de matar a cabe?a com esta merdas de programas meto um depois o outro nao trabalha depois nao sei mexer nesse programa :grrr:

? assim que fazes com os teus rips ?? :cheer:

_________________
Image Image Image Image

Sat Nov 29, 2008 1:54 am
Profile
cuub
Pukake
Pukake
User avatar

Joined: Tue Dec 11, 2007 2:10 am
Posts: 575
Post Re: Ripping/encoding/releasing Q & A Prt. II
Se quero converter, sim. (If i want to convert it, yes)

_________________
Sync your files online and across computers.
Access your files from any computer.
Collaborate on files with others.
Keep track of every version of your files.

Last edited by cuub on Sat Nov 29, 2008 1:57 am, edited 1 time in total.

Sat Nov 29, 2008 1:56 am
Profile
elguaxo
End of Level Boss
End of Level Boss
User avatar

Joined: Fri Mar 16, 2007 5:10 pm
Posts: 7535
Post Re: Ripping/encoding/releasing Q & A Prt. II
the original audio is not even DTS, its DTS-HD. ;)

The audio track of the REFiNED rip is DTS @ ~1536 Kbps and it was "stripped" out of the original DTS-HD track which had a bitrate of 3018 Kbps.

there are tons of audio reencoding applications. I posted a few already, search. ^^

edit: cuub posted one already ;)

_________________
Old2New SBiG URL Replacement Script | SBiG searchplugin
my AviSynth Plugins folder | Show Just Image 2 | Doom10

Sat Nov 29, 2008 1:57 am
Profile
cuub
Pukake
Pukake
User avatar

Joined: Tue Dec 11, 2007 2:10 am
Posts: 575
Post Re: Ripping/encoding/releasing Q & A Prt. II
Follow these steps...


_________________
Sync your files online and across computers.
Access your files from any computer.
Collaborate on files with others.
Keep track of every version of your files.

Sat Nov 29, 2008 2:09 am
Profile
Pure
Veggie Fridge
Veggie Fridge
User avatar

Joined: Fri Mar 24, 2006 2:59 pm
Posts: 21656
Location: Fuck You! GoodBye!
Post Re: Ripping/encoding/releasing Q & A Prt. II
elguaxo wrote:

there are tons of audio reencoding applications. I posted a few already, search. ^^

...


Or have a look at the index at the first page ;) :D
Sat Nov 29, 2008 2:45 am
Profile
elchupacabra
Tittietantalized
Tittietantalized
User avatar

Joined: Wed May 21, 2008 7:56 pm
Posts: 627
Post Re: Ripping/encoding/releasing Q & A Prt. II
elchupacabra wrote:
Pure wrote:
So it all came down to SetMTMode() ?


You have to call SetMTMode at the very beginning of your script, even if you are only using MT.


Forget this. It is not true. Putting SetMTMode probably only speeded up some other filter, that's why I experienced a speedup.

XviD generally has very little speedup using multithreading in AviSynth. Even the developer of this MT thingy doesn't know why. :sad:

Edit: new multithreaded XviD 1.3 here: http://forum.doom9.org/showthread.php?p ... ost1218162 I'm going to try it and see if it is faster.

_________________
elguaxo wrote:
x264 encoding guide: viewtopic.php?f=43&t=16224

Sat Nov 29, 2008 4:56 pm
Profile
elguaxo
End of Level Boss
End of Level Boss
User avatar

Joined: Fri Mar 16, 2007 5:10 pm
Posts: 7535
Post Re: Ripping/encoding/releasing Q & A Prt. II
If you want to try it in MeGUI, then just copy the xvidcore.dll of this new version to MeGUI's xvid_encraw folder. Tell us how it goes! :pooper:

_________________
Old2New SBiG URL Replacement Script | SBiG searchplugin
my AviSynth Plugins folder | Show Just Image 2 | Doom10

Sat Nov 29, 2008 5:09 pm
Profile
elchupacabra
Tittietantalized
Tittietantalized
User avatar

Joined: Wed May 21, 2008 7:56 pm
Posts: 627
Post Re: Ripping/encoding/releasing Q & A Prt. II
elguaxo wrote:
If you want to try it in MeGUI, then just copy the xvidcore.dll of this new version to MeGUI's xvid_encraw folder. Tell us how it goes! :pooper:


I am encoding with MeGUI at the moment.

I do it in 3 passes as you suggested. First "prerender job" pass is going to take 17,5 hours. The following 2 will hopefully be faster.

CPU usage is again at only 33%. If the prerendering job is also encoded with XviD this could be the reason. If not, there is definitely something wrong with AviSynth MTing and the 100% CPU usage using x264 is only due to the enormous computations needed for that codec which can be split up onto threads normally.

_________________
elguaxo wrote:
x264 encoding guide: viewtopic.php?f=43&t=16224

Sat Nov 29, 2008 8:47 pm
Profile
elchupacabra
Tittietantalized
Tittietantalized
User avatar

Joined: Wed May 21, 2008 7:56 pm
Posts: 627
Post Re: Ripping/encoding/releasing Q & A Prt. II
Encoding/rip finished.

1. pass (lossless prerender job): 17,25 hours [CPU usage was around 33%]
2. pass (XviD first pass): 24 minutes [CPU usage was around 33%]
3. pass (XviD second pass): 29 minutes [CPU usage was around 60% :hmmm:]

Took a bit more than 18 hours to encode. Which is a lot more faster than the 1 month duration (16 days for 1 pass) on my old box. :D

_________________
elguaxo wrote:
x264 encoding guide: viewtopic.php?f=43&t=16224

Sun Nov 30, 2008 3:21 pm
Profile
elguaxo
End of Level Boss
End of Level Boss
User avatar

Joined: Fri Mar 16, 2007 5:10 pm
Posts: 7535
Post Re: Ripping/encoding/releasing Q & A Prt. II
Great! Have you ever tried what I posted here: viewtopic.php?p=116724#p116724
elguaxo wrote:
there is also a native multithreaded version of mvtools and MCTemporalDenoise can use it. Under some circumstances it's a bit unstable, but the speed is great. Since the slowest part of your script is mvtools/MCTemporalDenoise, you could try the multithreaded version.

I'm sure you can speed up the filtering by %10-15 using that.

x264 fastest encoding settings are faster than Xvid fastest encoding settings and you still get near %100 CPU usage. It's not the "the enormous computations", it just multithreads better.

_________________
Old2New SBiG URL Replacement Script | SBiG searchplugin
my AviSynth Plugins folder | Show Just Image 2 | Doom10

Sun Nov 30, 2008 3:28 pm
Profile
elchupacabra
Tittietantalized
Tittietantalized
User avatar

Joined: Wed May 21, 2008 7:56 pm
Posts: 627
Post Re: Ripping/encoding/releasing Q & A Prt. II
elguaxo wrote:
Have you ever tried what I posted here: viewtopic.php?p=116724#p116724


I haven't tried it, because I could not find it.

However you should not use MT (split up one frame to multiple theads) with that filter, because the result looks very ugly/smudgy. All I could try is SetMTMode(2). Currently I'm using SetMTMode(6), because the filter otherwise crashes.

_________________
elguaxo wrote:
x264 encoding guide: viewtopic.php?f=43&t=16224

Sun Nov 30, 2008 3:42 pm
Profile
elguaxo
End of Level Boss
End of Level Boss
User avatar

Joined: Fri Mar 16, 2007 5:10 pm
Posts: 7535
Post Re: Ripping/encoding/releasing Q & A Prt. II
elchupacabra wrote:
However you should not use MT (split up one frame to multiple theads) with that filter, because the result looks very ugly/smudgy.


that's correct and the solution is the native multithreaded mvtools. I'll get the links later. ;)

_________________
Old2New SBiG URL Replacement Script | SBiG searchplugin
my AviSynth Plugins folder | Show Just Image 2 | Doom10

Sun Nov 30, 2008 3:47 pm
Profile
elguaxo
End of Level Boss
End of Level Boss
User avatar

Joined: Fri Mar 16, 2007 5:10 pm
Posts: 7535
Post Re: Ripping/encoding/releasing Q & A Prt. II
MCTemporalDenoise: http://forum.doom9.org/showthread.php?t=139766

Usage:
Code:
###  MCTemporalDenoise(i, radius, sigma, twopass, useTTmpSm, limit, limit2, fixFFT3D, chroma, GPU, MT, idx, interlaced,
###                    sharp, adapt, strength, SHmode, SHmethod, Slimit, Sovershoot, Tlimit, Tovershoot,
###                    protect, cutoff, threshold, maxdiff,
###                    AA, useEEDI2, reduc, maxd, AAthr, method,
###                    deblock, useQED, quant1, quant2,
###                    edgeclean, ECrad, ECthr, ECmode,
###                    stabilize, maxr, TTstr, 
###                    flat, GFthr, AGstr,
###                    bwbh, owoh, blksize, overlap,
###                    truemotion, safe, MVglobal,
###                    bt, ncpu, precision, mode,
###                    thSAD, thSAD2, thSCD1, thSCD2,
###                    pel, pelsearch, search, searchparam, MVsharp, DCT, p, settings,
###                    show, screenW, screenH)


MT: false=Use MVTools(official) or true=MVToolsMULTI
fft3d is also multithreaded. Use
ncpu = number of cores

and

MVToolsMULTI] (v1.9.7.1), the one needed by MCTemporalDenoise with MT=true. Use it instead of the regular mvtools: http://forum.doom9.org/showpost.php?p=1 ... count=1063

_________________
Old2New SBiG URL Replacement Script | SBiG searchplugin
my AviSynth Plugins folder | Show Just Image 2 | Doom10

Sun Nov 30, 2008 4:42 pm
Profile
elchupacabra
Tittietantalized
Tittietantalized
User avatar

Joined: Wed May 21, 2008 7:56 pm
Posts: 627
Post Re: Ripping/encoding/releasing Q & A Prt. II
Thanks for all the updates.

There are 4 DLL files within the MVTools_V1.9.7.1.rar. Which one should we use?

MSVC08-noSSE
MSVC08-SSE2
IC10-P4-SSE2
IC10-Core2-SSE

I guess MSVC08 means Microsoft Visual C++ 8.0.

_________________
elguaxo wrote:
x264 encoding guide: viewtopic.php?f=43&t=16224

Sun Nov 30, 2008 6:11 pm
Profile
beossoeb
Anal Treatment
Anal Treatment
User avatar

Joined: Sun Oct 26, 2008 12:45 am
Posts: 245
Post Re: Ripping/encoding/releasing Q & A Prt. II
And IC10 is Intel Compiler 10. Which one you need depends on your cpu.
Sun Nov 30, 2008 6:17 pm
Profile
elchupacabra
Tittietantalized
Tittietantalized
User avatar

Joined: Wed May 21, 2008 7:56 pm
Posts: 627
Post Re: Ripping/encoding/releasing Q & A Prt. II
beossoeb wrote:
And IC10 is Intel Compiler 10. Which one you need depends on your cpu.


Hi and thanks. ^^ That would mean IC10-Core2-SSE for my Intel Core2 Quad. :bang:

_________________
elguaxo wrote:
x264 encoding guide: viewtopic.php?f=43&t=16224

Sun Nov 30, 2008 6:55 pm
Profile
El Mariachi
buttfuckbullfrog
buttfuckbullfrog
User avatar

Joined: Tue Jul 04, 2006 10:35 am
Posts: 10201
Location: On top of a turd
Post Re: Ripping/encoding/releasing Q & A Prt. II
MeGui is working out really well for me (thanks Elguaxo)

I've 2 more questions to ask to anyone

How to play with colors and contrast.
I've finally ripped Something is Out There (1/3 DVD) but I find the contrast a bit off (no black, just a lot of gray)

I forgot how to make the mkv container. I had the program and I'll probably google it right after I press Submit

_________________
Your offer pleases the TechnoViking :oral:
Image

Mon Dec 01, 2008 5:39 pm
Profile
Display posts from previous:  Sort by  
Post new topic This topic is locked, you cannot edit posts or make further replies.  Page 5 of 126
  [ 3754 posts ]  Go to page Previous  1, 2, 3, 4, 5, 6, 7, 8 ... 126  Next

Board index » Help and Development » FAQ / Newbie - the starting point

All times are UTC + 1 hour [ DST ]

Who is online

Users browsing this forum: Bing [Bot] and 120 guests

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to: