osx - Mac OS X: GNU parallel can't find the number of cores on a remote server -
osx - Mac OS X: GNU parallel can't find the number of cores on a remote server -
i used homebrew install gnu parallel on mac can run tests remotely on university's servers. running through tutorials, when ran
parallel -s <username>@$server1 echo running on ::: <username>@$server1 i got message
parallel: warning: not figure out number of cpus on <username@server> (). using 1. possibly related, never added parallel path , got warning "parallel" wasn't recognized command, parallel ran anyways , still echo'd correctly. particular server has 16 cores, how can parallel recognize them?
gnu parallel less tested on os x not have access os x installation, have found bug.
gnu parallel has since 20120322 used these find number of cpus:
sysctl -n hw.physicalcpu sysctl -a hw 2>/dev/null | grep [^a-z]physicalcpu[^a-z] | awk '{ print \$2 }' and number of cores:
sysctl -n hw.logicalcpu sysctl -a hw 2>/dev/null | grep [^a-z]logicalcpu[^a-z] | awk '{ print \$2 }' can test output those?
which version of gnu parallel using?
as work around can forcefulness gnu parallel observe 16 cores:
parallel -s 16/<username>@$server1 echo running on ::: <username>@$server1 since version 20140422 have been able export path remote server:
parallel --env path -s 16/<username>@$server1 echo running on ::: <username>@$server1 that way need add together dir parallel lives on server path on local machine. e.g. parallel on remote server in /home/u/user/bin/parallel:
path=$path:/home/u/user/bin parallel --env path -s <username>@$server1 echo running on ::: <username>@$server1 information ole
my imac (osx mavericks on intel core i7) gives following, looks correct:
sysctl -n hw.physicalcpu 4 sysctl -a hw hw.ncpu: 8 hw.byteorder: 1234 hw.memsize: 17179869184 hw.activecpu: 8 hw.physicalcpu: 4 hw.physicalcpu_max: 4 hw.logicalcpu: 8 hw.logicalcpu_max: 8 hw.cputype: 7 hw.cpusubtype: 4 hw.cpu64bit_capable: 1 hw.cpufamily: 1418770316 hw.cacheconfig: 8 2 2 8 0 0 0 0 0 0 hw.cachesize: 17179869184 32768 262144 8388608 0 0 0 0 0 0 hw.pagesize: 4096 hw.busfrequency: 100000000 hw.busfrequency_min: 100000000 hw.busfrequency_max: 100000000 hw.cpufrequency: 3400000000 hw.cpufrequency_min: 3400000000 hw.cpufrequency_max: 3400000000 hw.cachelinesize: 64 hw.l1icachesize: 32768 hw.l1dcachesize: 32768 hw.l2cachesize: 262144 hw.l3cachesize: 8388608 hw.tbfrequency: 1000000000 hw.packages: 1 hw.optional.floatingpoint: 1 hw.optional.mmx: 1 hw.optional.sse: 1 hw.optional.sse2: 1 hw.optional.sse3: 1 hw.optional.supplementalsse3: 1 hw.optional.sse4_1: 1 hw.optional.sse4_2: 1 hw.optional.x86_64: 1 hw.optional.aes: 1 hw.optional.avx1_0: 1 hw.optional.rdrand: 0 hw.optional.f16c: 0 hw.optional.enfstrg: 0 hw.optional.fma: 0 hw.optional.avx2_0: 0 hw.optional.bmi1: 0 hw.optional.bmi2: 0 hw.optional.rtm: 0 hw.optional.hle: 0 hw.cputhreadtype: 1 hw.machine = x86_64 hw.model = imac12,2 hw.ncpu = 8 hw.byteorder = 1234 hw.physmem = 2147483648 hw.usermem = 521064448 hw.pagesize = 4096 hw.epoch = 0 hw.vectorunit = 1 hw.busfrequency = 100000000 hw.cpufrequency = 3400000000 hw.cachelinesize = 64 hw.l1icachesize = 32768 hw.l1dcachesize = 32768 hw.l2settings = 1 hw.l2cachesize = 262144 hw.l3settings = 1 hw.l3cachesize = 8388608 hw.tbfrequency = 1000000000 hw.memsize = 17179869184 hw.availcpu = 8 sysctl -n hw.logicalcpu 8 osx bash parallel-processing gnu gnu-parallel
Comments
Post a Comment