Parallel compression not using all available CPU

Jasse Jansson jasse at yberwaffe.com
Sat Dec 10 16:00:02 PST 2016


Have you tried to disable hypertreads in the BIOS ???
It's a long shot, I know, but it might help.

On 2016-12-10 22:14, PeerCorps Trust Fund wrote:
> Hi,
>
> On both systems HAMMER was used. One small correction concerning the 
> 2c/2t machine, both compression programs did effectively utilize that 
> CPU which had an idle % of 0.0. It is the bigger machine, 16c/32t 
> where the CPU isn't effectively maxed out. I'll continue to try and 
> investigate why and report back if I find anything.
>
>
> On 12/10/2016 10:26 PM, Justin Sherrill wrote:
>> On the two DragonFly systems, was it Hammer or UFS?  I would be
>> surprised if that made a difference, but it might?
>>
>> On Sat, Dec 10, 2016 at 6:19 AM, PeerCorps Trust Fund
>> <ipc at peercorpstrust.org> wrote:
>>> Hi,
>>>
>>> I've observed that parallel compression tools such as pixz and 
>>> lbzip2 do not
>>> make use of all of the available CPU under Dragonfly. On other OSes, it
>>> does.
>>>
>>> When testing on a 50 gb file, using top I've observed that CPU idle
>>> percentages consistently hover around the 90% range for pixz and 
>>> ~70% for
>>> lbzip2. These values under FreeBSD and Linux are typically ~0.0% 
>>> idle until
>>> compression is complete. Correspondingly, compression takes 
>>> significantly
>>> longer under Dragonfly, so the CPU is really being under utilized in 
>>> this
>>> case as opposed to erroneous reporting by top.
>>>
>>> This was tested on two systems, one 16c/32t and a 2c/2t system on a 
>>> recent
>>> master DragonFly v4.7.0.973.g8d7da-DEVELOPMENT #2: Wed Dec  7 
>>> 11:44:04 EET
>>> 2016.
>>>
>>> Has anyone else possibly observed this?
>>>
>>> -- 
>>> Mike
>>>
>>
>




More information about the Users mailing list