gdb output from vcache debug session
9/27/2006
tcsh pid 2040 starting c:/ak/putty/plink to somenode.com:
----------------------------------WARNING--------------------------------------
Use of this system by unauthorized persons or in an
unauthorized manner is strictly prohibited
To see this information again, type: more /etc/motd
*******************************************************************************
*******************************************************************************
No mail.
pwd
----------------------------------WARNING--------------------------------------
Use of this system by unauthorized persons or in an
unauthorized manner is strictly prohibited
To see this information again, type: more /etc/motd
*******************************************************************************
To report problems on this system, or to check outage information, please go
to http://xxx.xxx.xxx
*******************************************************************************
Directory: /nfs/site/home/jvkumpf
Wed Sep 27 18:14:37 PDT 2006
> pwd
/nfs/sc/home/jvkumpf
> source /p/bmp/vesta/bmp_val_startup.csh
source /p/bmp/vesta/bmp_val_startup.csh
> gdb
gdb
GNU gdb 6.3
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-unknown-linux-gnu".
(gdb) help attach
help attach
Attach to a process or file outside of GDB.
This command attaches to another target, of the same type as your last
"target" command ("info files" will show your target stack).
The command may take as argument a process id or a device file.
For a process id, you must have permission to send the process a signal,
and it must have the same effective uid as the debugger.
When using "attach" with a process id, the debugger finds the
program running in the process, looking first in the current working
directory, or (if not found there) using the source file search path
(see the "directory" command). You can also use the "file" command
to specify the program, and to load its symbol table.
(gdb) attach 32693
attach 32693
Attaching to process 32693
ptrace: Operation not permitted.
(gdb) quit
quit
> su vadmin
Password: ****
Skipped: /nfs/sc/gen/adm/stdenv/system/cshrc
WARNING: $PROJ_ENV is not set.
[1mbmp-vesta[m home/jvkumpf> gdb
gdb
GNU gdb 6.2.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-suse-linux".
(gdb) attach 32693
attach 32693
Attaching to process 32693
Reading symbols from /vesta-srv/new_vesta_bin/cache_54/VCache...done.
Using host libthread_db library "/lib64/tls/libthread_db.so.1".
Reading symbols from /nfs/user/home/vadmin/new_vesta_lib/libstdc++.so.6...done.
Loaded symbols for /nfs/user/home/vadmin/new_vesta_lib/libstdc++.so.6
Reading symbols from /lib64/tls/libpthread.so.0...done.
[Thread debugging using libthread_db enabled]
[New Thread 182903169184 (LWP 32693)]
[New Thread 186706823520 (LWP 9051)]
[New Thread 186577062240 (LWP 10608)]
[New Thread 186568673632 (LWP 9943)]
[New Thread 186543245664 (LWP 23172)]
[New Thread 186534857056 (LWP 12269)]
[New Thread 186526468448 (LWP 645)]
[New Thread 186400639328 (LWP 28856)]
[New Thread 186392250720 (LWP 5663)]
[New Thread 186383862112 (LWP 5660)]
[New Thread 186375473504 (LWP 5367)]
[New Thread 186367084896 (LWP 14096)]
[New Thread 186358696288 (LWP 24284)]
[New Thread 186350307680 (LWP 24134)]
[New Thread 186341919072 (LWP 24133)]
[New Thread 186333530464 (LWP 22791)]
[New Thread 186325141856 (LWP 18270)]
[New Thread 186316753248 (LWP 17550)]
[New Thread 186308364640 (LWP 17549)]
[New Thread 186299976032 (LWP 17547)]
[New Thread 186291587424 (LWP 17506)]
[New Thread 186283198816 (LWP 17504)]
[New Thread 186274810208 (LWP 16949)]
[New Thread 186266421600 (LWP 15410)]
[New Thread 186258032992 (LWP 15022)]
[New Thread 186249644384 (LWP 7172)]
[New Thread 186224216416 (LWP 9579)]
[New Thread 186064570720 (LWP 21557)]
[New Thread 186056182112 (LWP 13500)]
[New Thread 186047793504 (LWP 12829)]
[New Thread 186039404896 (LWP 12362)]
[New Thread 186031016288 (LWP 12361)]
[New Thread 186022627680 (LWP 12360)]
[New Thread 186014239072 (LWP 12359)]
[New Thread 186005850464 (LWP 12358)]
[New Thread 185997461856 (LWP 11275)]
[New Thread 185989073248 (LWP 11226)]
[New Thread 185980684640 (LWP 4020)]
[New Thread 185972296032 (LWP 31402)]
[New Thread 185843059040 (LWP 13369)]
[New Thread 185834670432 (LWP 8748)]
[New Thread 185826281824 (LWP 7798)]
[New Thread 185817893216 (LWP 7780)]
[New Thread 185809504608 (LWP 7778)]
[New Thread 185801116000 (LWP 7777)]
[New Thread 185792727392 (LWP 7774)]
[New Thread 185784338784 (LWP 7770)]
[New Thread 185775950176 (LWP 7261)]
[New Thread 185597167968 (LWP 11710)]
[New Thread 185588779360 (LWP 11171)]
[New Thread 185580390752 (LWP 9871)]
[New Thread 184941017440 (LWP 18749)]
[New Thread 184932628832 (LWP 18748)]
[New Thread 184924240224 (LWP 18000)]
[New Thread 184915851616 (LWP 17950)]
[New Thread 184907463008 (LWP 17949)]
[New Thread 184339134816 (LWP 28337)]
[New Thread 184330746208 (LWP 28273)]
[New Thread 184322357600 (LWP 28272)]
[New Thread 184313968992 (LWP 28265)]
[New Thread 184305580384 (LWP 28264)]
[New Thread 184297191776 (LWP 28263)]
[New Thread 184288803168 (LWP 9443)]
[New Thread 184280414560 (LWP 8135)]
[New Thread 184272025952 (LWP 3831)]
[New Thread 184263637344 (LWP 2740)]
[New Thread 184255248736 (LWP 2736)]
[New Thread 184246860128 (LWP 2728)]
[New Thread 184238471520 (LWP 2338)]
[New Thread 184230082912 (LWP 780)]
[New Thread 184221694304 (LWP 31743)]
[New Thread 184213305696 (LWP 31691)]
[New Thread 184204917088 (LWP 31690)]
[New Thread 184196528480 (LWP 26586)]
[New Thread 184188139872 (LWP 25242)]
[New Thread 184179751264 (LWP 25241)]
[New Thread 184171362656 (LWP 25239)]
[New Thread 184162974048 (LWP 13030)]
[New Thread 184154585440 (LWP 12945)]
[New Thread 184146196832 (LWP 12944)]
[New Thread 184137808224 (LWP 12943)]
[New Thread 184129419616 (LWP 12942)]
[New Thread 184121031008 (LWP 12941)]
[New Thread 184112642400 (LWP 12940)]
[New Thread 184104253792 (LWP 12939)]
[New Thread 184095865184 (LWP 18219)]
[New Thread 184087476576 (LWP 27162)]
[New Thread 184079087968 (LWP 26987)]
[New Thread 184070699360 (LWP 26986)]
[New Thread 184062310752 (LWP 26985)]
[New Thread 184053922144 (LWP 26984)]
[New Thread 184045533536 (LWP 26983)]
[New Thread 184037144928 (LWP 26982)]
[New Thread 184028756320 (LWP 26981)]
[New Thread 184020367712 (LWP 25562)]
[New Thread 184011979104 (LWP 25240)]
[New Thread 184003590496 (LWP 25222)]
[New Thread 183995201888 (LWP 25221)]
[New Thread 183986813280 (LWP 25220)]
[New Thread 183978424672 (LWP 12975)]
[New Thread 183970036064 (LWP 12841)]
[New Thread 183961647456 (LWP 12840)]
[New Thread 183953258848 (LWP 12839)]
[New Thread 183944870240 (LWP 12838)]
[New Thread 183936481632 (LWP 12837)]
[New Thread 183928093024 (LWP 12836)]
[New Thread 183919704416 (LWP 10595)]
[New Thread 183911315808 (LWP 10179)]
[New Thread 183902927200 (LWP 10020)]
[New Thread 183894538592 (LWP 10019)]
[New Thread 183886149984 (LWP 10018)]
[New Thread 183877761376 (LWP 10017)]
[New Thread 183869372768 (LWP 10016)]
[New Thread 183860984160 (LWP 10015)]
[New Thread 183852595552 (LWP 10012)]
[New Thread 183844206944 (LWP 23481)]
[New Thread 183835818336 (LWP 24574)]
[New Thread 183827429728 (LWP 23296)]
[New Thread 183819041120 (LWP 23295)]
[New Thread 183810652512 (LWP 23294)]
[New Thread 183802263904 (LWP 23293)]
[New Thread 183793875296 (LWP 23292)]
[New Thread 183785486688 (LWP 18534)]
[New Thread 183777098080 (LWP 17663)]
[New Thread 183768709472 (LWP 17662)]
[New Thread 183760320864 (LWP 17661)]
[New Thread 183751932256 (LWP 17660)]
[New Thread 183743543648 (LWP 17659)]
[New Thread 183735155040 (LWP 17658)]
[New Thread 183726766432 (LWP 17657)]
[New Thread 183718377824 (LWP 16902)]
[New Thread 183709989216 (LWP 15323)]
[New Thread 183701600608 (LWP 11059)]
[New Thread 2147481952 (LWP 10798)]
[New Thread 2139093344 (LWP 10797)]
[New Thread 2130704736 (LWP 10796)]
[New Thread 2122316128 (LWP 10795)]
[New Thread 2113927520 (LWP 10794)]
[New Thread 2105538912 (LWP 10690)]
[New Thread 2097150304 (LWP 25286)]
[New Thread 2088761696 (LWP 24492)]
[New Thread 2080373088 (LWP 24490)]
[New Thread 2071984480 (LWP 24489)]
[New Thread 2063595872 (LWP 24488)]
[New Thread 2055207264 (LWP 24485)]
[New Thread 2046818656 (LWP 24479)]
[New Thread 2038430048 (LWP 24477)]
[New Thread 2030041440 (LWP 11709)]
[New Thread 2021652832 (LWP 8594)]
[New Thread 2013264224 (LWP 7661)]
[New Thread 2004875616 (LWP 7655)]
[New Thread 1996487008 (LWP 7650)]
[New Thread 1988098400 (LWP 7649)]
[New Thread 1979709792 (LWP 7647)]
[New Thread 1971321184 (LWP 7644)]
[New Thread 1962932576 (LWP 7642)]
[New Thread 1954543968 (LWP 23708)]
[New Thread 1946155360 (LWP 13841)]
[New Thread 1937766752 (LWP 13840)]
[New Thread 1929378144 (LWP 13839)]
[New Thread 1920989536 (LWP 13837)]
[New Thread 1912600928 (LWP 13836)]
[New Thread 1904212320 (LWP 11565)]
[New Thread 1895823712 (LWP 11513)]
[New Thread 1887435104 (LWP 11169)]
[New Thread 1879046496 (LWP 11168)]
[New Thread 1870657888 (LWP 11167)]
[New Thread 1862269280 (LWP 11166)]
[New Thread 1853880672 (LWP 11165)]
[New Thread 1845492064 (LWP 6845)]
[New Thread 1837103456 (LWP 29607)]
[New Thread 1828714848 (LWP 28250)]
[New Thread 1820326240 (LWP 28248)]
[New Thread 1811937632 (LWP 28243)]
[New Thread 1803549024 (LWP 28242)]
[New Thread 1795160416 (LWP 28235)]
[New Thread 1786771808 (LWP 28234)]
[New Thread 1778383200 (LWP 28233)]
[New Thread 1769994592 (LWP 19156)]
[New Thread 1761605984 (LWP 18593)]
[New Thread 1753217376 (LWP 18075)]
[New Thread 1744828768 (LWP 18074)]
[New Thread 1736440160 (LWP 18073)]
[New Thread 1728051552 (LWP 18069)]
[New Thread 1719662944 (LWP 18063)]
[New Thread 1711274336 (LWP 18061)]
[New Thread 1702885728 (LWP 18060)]
[New Thread 1694497120 (LWP 4136)]
[New Thread 1686108512 (LWP 3548)]
[New Thread 1677719904 (LWP 14016)]
[New Thread 1669331296 (LWP 14015)]
[New Thread 1660942688 (LWP 14014)]
[New Thread 1652554080 (LWP 14013)]
[New Thread 1644165472 (LWP 13024)]
[New Thread 1635776864 (LWP 2761)]
[New Thread 1627388256 (LWP 2466)]
[New Thread 1618999648 (LWP 2465)]
[New Thread 1610611040 (LWP 2464)]
[New Thread 1602222432 (LWP 2463)]
[New Thread 1593833824 (LWP 2462)]
[New Thread 1585445216 (LWP 11090)]
[New Thread 1577056608 (LWP 10992)]
[New Thread 1568668000 (LWP 10991)]
[New Thread 1560279392 (LWP 10990)]
[New Thread 1551890784 (LWP 10989)]
[New Thread 1543502176 (LWP 10988)]
[New Thread 1535113568 (LWP 10987)]
[New Thread 1526724960 (LWP 10986)]
[New Thread 1518336352 (LWP 1993)]
[New Thread 1509947744 (LWP 1599)]
[New Thread 1501559136 (LWP 1598)]
[New Thread 1493170528 (LWP 1597)]
[New Thread 1484781920 (LWP 1596)]
[New Thread 1476393312 (LWP 1595)]
[New Thread 1468004704 (LWP 1594)]
[New Thread 1459616096 (LWP 1593)]
[New Thread 1451227488 (LWP 1543)]
[New Thread 1442838880 (LWP 1177)]
[New Thread 1434450272 (LWP 639)]
[New Thread 1426061664 (LWP 638)]
[New Thread 1417673056 (LWP 637)]
[New Thread 1409284448 (LWP 636)]
[New Thread 1400895840 (LWP 635)]
[New Thread 1392507232 (LWP 634)]
[New Thread 1384118624 (LWP 30822)]
[New Thread 1375730016 (LWP 21102)]
[New Thread 1367341408 (LWP 21029)]
[New Thread 1358952800 (LWP 21028)]
[New Thread 1350564192 (LWP 21027)]
[New Thread 1342175584 (LWP 21026)]
[New Thread 1333786976 (LWP 21025)]
[New Thread 1325398368 (LWP 21024)]
[New Thread 1317009760 (LWP 21022)]
[New Thread 1308621152 (LWP 18155)]
[New Thread 1300232544 (LWP 16685)]
[New Thread 1291843936 (LWP 16684)]
[New Thread 1283455328 (LWP 16683)]
[New Thread 1275066720 (LWP 8984)]
[New Thread 1266678112 (LWP 8284)]
[New Thread 1258289504 (LWP 8283)]
[New Thread 1249900896 (LWP 6010)]
[New Thread 1241512288 (LWP 29349)]
[New Thread 1233123680 (LWP 28491)]
[New Thread 1224735072 (LWP 28441)]
[New Thread 1216346464 (LWP 28001)]
[New Thread 1207957856 (LWP 28000)]
[New Thread 1199569248 (LWP 27999)]
[New Thread 1191180640 (LWP 27998)]
[New Thread 1182792032 (LWP 27997)]
[New Thread 1174403424 (LWP 27862)]
[New Thread 1166014816 (LWP 32757)]
[New Thread 1157626208 (LWP 32708)]
[New Thread 1149237600 (LWP 32707)]
[New Thread 1140848992 (LWP 32706)]
[New Thread 1132460384 (LWP 32705)]
[New Thread 1124071776 (LWP 32704)]
[New Thread 1115683168 (LWP 32703)]
[New Thread 1107294560 (LWP 32702)]
[New Thread 1098905952 (LWP 32701)]
[New Thread 1090517344 (LWP 32700)]
[New Thread 1082128736 (LWP 32699)]
Loaded symbols for /lib64/tls/libpthread.so.0
Reading symbols from /lib64/tls/libm.so.6...done.
Loaded symbols for /lib64/tls/libm.so.6
Reading symbols from /lib64/tls/libc.so.6...done.
Loaded symbols for /lib64/tls/libc.so.6
Reading symbols from /lib64/libgcc_s.so.1...done.
Loaded symbols for /lib64/libgcc_s.so.1
Reading symbols from /lib64/ld-linux-x86-64.so.2...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2
Reading symbols from /lib64/libnss_files.so.2...done.
Loaded symbols for /lib64/libnss_files.so.2
Reading symbols from /lib64/libnss_dns.so.2...done.
Loaded symbols for /lib64/libnss_dns.so.2
Reading symbols from /lib64/libresolv.so.2...done.
Loaded symbols for /lib64/libresolv.so.2
0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
(gdb) where
where
#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
#1 0x000000000044c067 in TCP_sock::fill_rcvbuffer (this=0x2b232eaa20)
at TCP_sock.C:1425
#2 0x000000000044c31c in TCP_sock::recv_data (this=0x2b232eaa20,
buffer=0x7fbfffd5f7 "\v Mn\226*", len=1) at TCP_sock.C:1470
#3 0x00000000004567b6 in SRPC_impl::recv_bytes (this=0x2a966e4d20,
bs=0x7fbfffd5f7 "\v Mn\226*", len=1) at SRPC_impl.C:280
#4 0x0000000000456aea in SRPC_impl::read_item_code (this=0x2a966e4d20)
at SRPC_impl.C:368
#5 0x000000000044df28 in SRPC::await_call (this=0x2a9f5bf6e0,
proc_id=@0x7fbfffd6dc, intf_version=@0x7fbfffd6d8) at SRPC.C:226
#6 0x0000000000453691 in LimService::Run (this=0x2a95ef1e00)
at LimService.C:208
#7 0x0000000000414ccb in ExpCache::Run (this=0x2a95efb5b8) at ExpCache.C:107
#8 0x00000000004187bd in Server (argc=1, argv=0x7fbfffd8e8) at VCache.C:142
#9 0x0000000000418891 in main (argc=1, argv=0x7fbfffd8e8) at VCache.C:159
(gdb) help threads
help threads
Undefined command: "threads". Try "help".
(gdb) help thread
help thread
Use this command to switch between threads.
The new thread ID must be currently known.
List of thread subcommands:
thread apply -- Apply a command to a list of threads
Type "help thread" followed by thread subcommand name for full documentation.
Command name abbreviations are allowed if unambiguous.
(gdb) thread 182903169184
thread 182903169184
Thread ID -1780424544 not known.
(gdb) thread 32693
thread 32693
Thread ID 32693 not known.
(gdb) thread 1
thread 1
[Switching to thread 1 (Thread 182903169184 (LWP 32693))]#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
(gdb) thread 2
thread 2
[Switching to thread 2 (Thread 186706823520 (LWP 9051))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 3
thread 3
[Switching to thread 3 (Thread 186577062240 (LWP 10608))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 4
thread 4
[Switching to thread 4 (Thread 186568673632 (LWP 9943))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 5
thread 5
[Switching to thread 5 (Thread 186543245664 (LWP 23172))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 6
thread 6
[Switching to thread 6 (Thread 186534857056 (LWP 12269))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 7
thread 7
[Switching to thread 7 (Thread 186526468448 (LWP 645))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 8
thread 8
[Switching to thread 8 (Thread 186400639328 (LWP 28856))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 9
thread 9
[Switching to thread 9 (Thread 186392250720 (LWP 5663))]#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
(gdb) thread 10
thread 10
[Switching to thread 10 (Thread 186383862112 (LWP 5660))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 11
thread 11
[Switching to thread 11 (Thread 186375473504 (LWP 5367))]#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
(gdb) thread 12
tthread 13
hread 12
[Switching to thread 12 (Thread 186367084896 (LWP 14096))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thrthread 14
ead 13
[Switching to thread 13 (Thread 186358696288 (LWP 24284))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) tthread 15
hread 14
[Switching to thread 14 (Thread 186350307680 (LWP 24134))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 15
[Switching to thread 15 (Thread 186341919072 (LWP 24133))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 16
tthread 17
hread 16
[Switching to thread 16 (Thread 186333530464 (LWP 22791))]#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
(gdb) thread 18
thread 17
[Switching to thread 17 (Thread 186325141856 (LWP 18270))]#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
(gdb) thread 19
thread 18
[Switching to thread 18 (Thread 186316753248 (LWP 17550))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 20
thread 19
[Switching to thread 19 (Thread 186308364640 (LWP 17549))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 21
thread 20
[Switching to thread 20 (Thread 186299976032 (LWP 17547))]#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
(gdb) thread 22
thread 21
[Switching to thread 21 (Thread 186291587424 (LWP 17506))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 23
thread 22
[Switching to thread 22 (Thread 186283198816 (LWP 17504))]#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
(gdb) thread 24
thread 23
[Switching to thread 23 (Thread 186274810208 (LWP 16949))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 25
thread 24
[Switching to thread 24 (Thread 186266421600 (LWP 15410))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 26
thread 25
[Switching to thread 25 (Thread 186258032992 (LWP 15022))]#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
(gdb) thread 27
thread 26
[Switching to thread 26 (Thread 186249644384 (LWP 7172))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 28
thread 27
[Switching to thread 27 (Thread 186224216416 (LWP 9579))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 29
thread 28
[Switching to thread 28 (Thread 186064570720 (LWP 21557))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 30
thread 29
[Switching to thread 29 (Thread 186056182112 (LWP 13500))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 31
thread 30
[Switching to thread 30 (Thread 186047793504 (LWP 12829))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 32
thread 31
[Switching to thread 31 (Thread 186039404896 (LWP 12362))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 33
thread 32
[Switching to thread 32 (Thread 186031016288 (LWP 12361))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 34
thread 33
[Switching to thread 33 (Thread 186022627680 (LWP 12360))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 35
thread 34
[Switching to thread 34 (Thread 186014239072 (LWP 12359))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 35
[Switching to thread 35 (Thread 186005850464 (LWP 12358))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 36
thread 37
thread 38
thread 39
thread 40
thread 41
tthread 42
thread 43
thread 44
hread 36
[Switching to thread 36 (Thread 185997461856 (LWP 11275))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 45
thread 46
thread 47
thread 48
thread 37
[Switching to thread 37 (Thread 185989073248 (LWP 11226))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 38
[Switching to thread 38 (Thread 185980684640 (LWP 4020))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 39
[Switching to thread 39 (Thread 185972296032 (LWP 31402))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 49
thread 50
thread 51
thread 52
thread 53
thread 54
thread 55
thread 40
[Switching to thread 40 (Thread 185843059040 (LWP 13369))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 41
[Switching to thread 41 (Thread 185834670432 (LWP 8748))]#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
(gdb) thread 42
[Switching to thread 42 (Thread 185826281824 (LWP 7798))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 43
[Switching to thread 43 (Thread 185817893216 (LWP 7780))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) threadthread 56
thread 57
thread 58
44
[Switching to thread 44 (Thread 185809504608 (LWP 7778))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 45
[Switching to thread 45 (Thread 185801116000 (LWP 7777))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 46
[Switching to thread 46 (Thread 185792727392 (LWP 7774))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 47
[Switching to thread 47 (Thread 185784338784 (LWP 7770))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 48
[Switching to thread 48 (Thread 185775950176 (LWP 7261))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thrthread 59
thread 60
thread 61
ead 49
[Switching to thread 49 (Thread 185597167968 (LWP 11710))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 50
[Switching to thread 50 (Thread 185588779360 (LWP 11171))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 51
thread 62
thread 63
thread 64
[Switching to thread 51 (Thread 185580390752 (LWP 9871))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 52
[Switching to thread 52 (Thread 184941017440 (LWP 18749))]#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
(gdb) thread 53
[Switching to thread 53 (Thread 184932628832 (LWP 18748))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 54
[Switching to thread 54 (Thread 184924240224 (LWP 18000))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 55
[Switching to thread 55 (Thread 184915851616 (LWP 17950))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 56
[Switching to thread 56 (Thread 184907463008 (LWP 17949))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 65
thread 66
thread 67
thread 68
thread 57
[Switching to thread 57 (Thread 184339134816 (LWP 28337))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 58
[Switching to thread 58 (Thread 184330746208 (LWP 28273))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 59
[Switching to thread 59 (Thread 184322357600 (LWP 28272))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 60
[Switching to thread 60 (Thread 184313968992 (LWP 28265))]#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
(gdb) thread 61
[Switching to thread 61 (Thread 184305580384 (LWP 28264))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 62
[Switching to thread 62 (Thread 184297191776 (LWP 28263))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 63
[Switching to threadthread 69
63 (Thread 184288803168 (LWP 9443))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 70
thread 71
thread 64
[Switching to thread 64 (Thread 184280414560 (LWP 8135))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 65
[Switching to thread 65 (Thread 184272025952 (LWP 3831))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 66
[Switching to thread 66 (Thread 184263637344 (LWP 2740))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 67
[Switching to thread 67 (Thread 184255248736 (LWP 2736))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 72
thread 73
thread 74
thread 75
thread 68
[Switching to thread 68 (Thread 184246860128 (LWP 2728))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 69
[Switching to thread 69 (Thread 184238471520 (LWP 2338))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 70
[Switching to thread 70 (Thread 184230082912 (LWP 780))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 76
thread 71
[Switching to thread 71 (Thread 184221694304 (LWP 31743))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 72
[Switching to thread 72 (Thread 184213305696 (LWP 31691))]#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
(gdb) thread 73
[Switching to thread 73 (Thread 184204917088 (LWP 31690))]#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
(gdb) thread 74
[Switching to thread 74 (Thread 184196528480 (LWP 26586))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 75
[Switching to thread 75 (Thread 184188139872 (LWP 25242))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 76
[Switching to thread 76 (Thread 184179751264 (LWP 25241))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 77
tthread 78
hread 77
[Switching to thread 77 (Thread 184171362656 (LWP 25239))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 79
thread 78
[Switching to thread 78 (Thread 184162974048 (LWP 13030))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 80
thread 79
[Switching to thread 79 (Thread 184154585440 (LWP 12945))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 81
thread 80
[Switching to thread 80 (Thread 184146196832 (LWP 12944))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 82
thread 81
[Switching to thread 81 (Thread 184137808224 (LWP 12943))]#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
(gdb) thread 82
[Switching to thread 82 (Thread 184129419616 (LWP 12942))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 83
thread 84
thread 85
thread 86
thread 87
tthread 88
thread 89
thread 90
thread 91
hread 83
[Switching to thread 83 (Thread 184121031008 (LWP 12941))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 92
thread 93
thread 94
thread 84
[Switching to thread 84 (Thread 184112642400 (LWP 12940))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 85
[Switching to thread 85 (Thread 184104253792 (LWP 12939))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 86
[Switching to thread 86 (Thread 184095865184 (LWP 18219))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 95
thread 96
thread 87
[Switching to thread 87 (Thread 184087476576 (LWP 27162))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 88
[Switching to thread 88 (Thread 184079087968 (LWP 26987))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 89
[Switching to thread 89 (Thread 184070699360 (LWP 26986))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 90
[Switching to thread 90 (Thread 184062310752 (LWP 26985))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 91
[Switching to thread 91 (Thread 184053922144 (LWP 26984))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 92
[Switching to thread 92 (Thread 184045533536 (LWP 26983))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 93
[Switching to thread 93 (Thread 184037144928 (LWP 26982))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 94
[Switching to thread 94 (Thread 184028756320 (LWP 26981))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 95
[Switching to thread 95 (Thread 184020367712 (LWP 25562))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 96
[Switching to thread 96 (Thread 184011979104 (LWP 25240))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 97
thread 97
[Switching to thread 97 (Thread 184003590496 (LWP 25222))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 98
thread 99
thread 100
thread 101
thread 102
thread 98
thread 103
thread 104
thread 105
thread 106
[Switching to thread 98 (Thread 183995201888 (LWP 25221))]#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
(gdb) thread 107
thread 108
thread 109
thread 110
thread 99
[Switching to thread 99 (Thread 183986813280 (LWP 25220))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 100
[Switching to thread 100 (Thread 183978424672 (LWP 12975))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 101
[Switching to thread 101 (Thread 183970036064 (LWP 12841))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 102
[Switching to thread 102 (Thread 183961647456 (LWP 12840))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 103
[Switching to thread 103 (Thread 183953258848 (LWP 12839))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 104
[Switching to thread 104 (Thread 183944870240 (LWP 12838))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 105
[Switching to thread 105 (Thread 183936481632 (LWP 12837))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 106
[Switching to thread 106 (Thread 183928093024 (LWP 12836))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 107
[Switching to thread 107 (Thread 183919704416 (LWP 10595))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 108
[Switching to thread 108 (Thread 183911315808 (LWP 10179))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 109
[Switching to thread 109 (Thread 183902927200 (LWP 10020))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 110
[Switching to thread 110 (Thread 183894538592 (LWP 10019))]#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
(gdb) thread 111
thread 111
[Switching to thread 111 (Thread 183886149984 (LWP 10018))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 112
thread 113
thread 114
thread 115
thread 116
tthread 117
thread 118
thread 119
thread 120
hread 112
[Switching to thread 112 (Thread 183877761376 (LWP 10017))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 121
thread 122
thread 123
thread 124
thread 125
thread 126
thread 127
thread 113
[Switching to thread 113 (Thread 183869372768 (LWP 10016))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 114
[Switching to thread 114 (Thread 183860984160 (LWP 10015))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 115
[Switching to thread 115 (Thread 183852595552 (LWP 10012))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 116
[Switching to thread 116 (Thread 183844206944 (LWP 23481))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 117
[Switching to thread 117 (Thread 183835818336 (LWP 24574))]#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
(gdb) thread 118
[Switching to thread 118 (Thread 183827429728 (LWP 23296))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 119
[Switching to thread 119 (Thread 183819041120 (LWP 23295))]#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
(gdb) thread 120
[Switching to thread 120 (Thread 183810652512 (LWP 23294))]#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
(gdb) thread 121
[Switching to thread 121 (Thread 183802263904 (LWP 23293))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 122
[Switching to thread 122 (Thread 183793875296 (LWP 23292))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 123
[Switching to thread 123 (Thread 183785486688 (LWP 18534))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 124
[Switching to thread 124 (Thread 183777098080 (LWP 17663))]#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
(gdb) thread 125
[Switching to thread 125 (Thread 183768709472 (LWP 17662))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 126
[Switching to thread 126 (Thread 183760320864 (LWP 17661))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 127
[Switching to thread 127 (Thread 183751932256 (LWP 17660))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 128
thread 129
thread 128
[Switching to thread 128 (Thread 183743543648 (LWP 17659))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 130
thread 129
[Switching to thread 129 (Thread 183735155040 (LWP 17658))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 131
thread 130
[Switching to thread 130 (Thread 183726766432 (LWP 17657))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 131
[Switching to thread 131 (Thread 183718377824 (LWP 16902))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) thread 117
thread 117
[Switching to thread 117 (Thread 183835818336 (LWP 24574))]#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
(gdb) where
where
#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
#1 0x000000000044c067 in TCP_sock::fill_rcvbuffer (this=0x2a9e13c510)
at TCP_sock.C:1425
#2 0x000000000044c31c in TCP_sock::recv_data (this=0x2a9e13c510,
buffer=0x2acd77f597 "", len=1) at TCP_sock.C:1470
#3 0x00000000004567b6 in SRPC_impl::recv_bytes (this=0x2a9bf9d348,
bs=0x2acd77f597 "", len=1) at SRPC_impl.C:280
#4 0x0000000000456aea in SRPC_impl::read_item_code (this=0x2a9bf9d348)
at SRPC_impl.C:368
#5 0x000000000044df28 in SRPC::await_call (this=0x2a968c2ff0,
proc_id=@0x2acd77f6a8, intf_version=@0x2acd77f6ac) at SRPC.C:226
#6 0x0000000000453d36 in LimService::NewConnection (this=0x2a95ef1e00,
srpc=0x2a968c2ff0, intfVersion=22, procId=-1) at LimService.C:330
#7 0x0000000000454237 in LimService_Worker (arg=0x2aaaf9ef00)
at LimService.C:405
#8 0x00000000004657dd in ThreadStart_Callback (arg=0x2ab0e00780)
at ThreadStartPlain.C:58
#9 0x0000000000470849 in GC_start_routine (arg=0x8d) at pthread_support.c:1182
#10 0x0000002a9587b919 in start_thread () from /lib64/tls/libpthread.so.0
#11 0x0000002a95b988a3 in thread_start () from /lib64/tls/libc.so.6
#12 0x0000000000000000 in ?? ()
#13 0x0000000000000000 in ?? ()
#14 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---
#15 0x0000000000000000 in ?? ()
#16 0x0000000000000000 in ?? ()
#17 0x0000000000000000 in ?? ()
#18 0x0000000000000000 in ?? ()
#19 0x0000000000000000 in ?? ()
#20 0x0000000000000000 in ?? ()
#21 0x0000000000000000 in ?? ()
#22 0x0000002a95ce64c0 in _nl_C_locobj () from /lib64/tls/libc.so.6
#23 0x0000002acd77fdc0 in ?? ()
#24 0x0000000000000004 in ?? ()
#25 0x0000000000000000 in ?? ()
#26 0x0000000000000000 in ?? ()
#27 0x0000002a95cfe300 in __malloc_initialize_hook () from /lib64/tls/libc.so.6
#28 0x0000000000000000 in ?? ()
#29 0x0000000000000000 in ?? ()
#30 0x0000000000000000 in ?? ()
#31 0x0000002acd77f960 in ?? ()
#32 0x0000000000637418 in ?? ()
#33 0x0000002acd77f960 in ?? ()
#34 0x0000000000000001 in ?? ()
#35 0x0000000000000000 in ?? ()
#36 0x0000000000000000 in ?? ()
#37 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---
#38 0x0000000000000000 in ?? ()
#39 0x0000000000000000 in ?? ()
#40 0x0000000000000000 in ?? ()
#41 0x0000000000000000 in ?? ()
#42 0x0000000000000000 in ?? ()
#43 0x0000000000000000 in ?? ()
#44 0x0000000000000000 in ?? ()
#45 0x0000000000000000 in ?? ()
#46 0x0000002accf7f9e0 in ?? ()
#47 0x0000002acdf7f9e0 in ?? ()
#48 0x00007fb500005ffe in ?? ()
#49 0x0000000000000000 in ?? ()
#50 0x0000002acd77f770 in ?? ()
#51 0x0000000000000002 in ?? ()
#52 0x0000000000637530 in ?? ()
#53 0x0000000000000000 in ?? ()
#54 0x0000000000000000 in ?? ()
#55 0x0000000000000000 in ?? ()
#56 0x0000000000000000 in ?? ()
#57 0x0000000000000000 in ?? ()
#58 0x0000000000000000 in ?? ()
#59 0x0000000000000000 in ?? ()
#60 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---
...
---Type <return> to continue, or q <return> to quit---
#9927 0x0000000000000000 in ?? ()
#9928 0x0000000000000000 in ?? ()
#9929 0x0000000000000000 in ?? ()
#9930 0x0000000000000000 in ?? ()
#9931 0x0000000000000000 in ?? ()
#9932 0x0000000000000000 in ?? ()
#9933 0x0000000000000000 in ?? ()
#9934 0x0000000000000000 in ?? ()
#9935 0x0000000000000000 in ?? ()
#9936 0x0000000000000000 in ?? ()
#9937 0x0000000000000000 in ?? ()
#9938 0x0000000000000000 in ?? ()
#9939 0x0000000000000000 in ?? ()
#9940 0x0000000000000000 in ?? ()
#9941 0x0000000000000000 in ?? ()
#9942 0x0000000000000000 in ?? ()
#9943 0x0000000000000000 in ?? ()
#9944 0x0000000000000000 in ?? ()
#9945 0x0000000000000000 in ?? ()
#9946 0x0000000000000000 in ?? ()
#9947 0x0000000000000000 in ?? ()
#9948 0x0000000000000000 in ?? ()
#9949 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---
#9950 0x0000000000000000 in ?? ()
#9951 0x0000000000000000 in ?? ()
#9952 0x0000000000000000 in ?? ()
#9953 0x0000000000000000 in ?? ()
#9954 0x0000000000000000 in ?? ()
#9955 0x0000000000000000 in ?? ()
#9956 0x0000000000000000 in ?? ()
#9957 0x0000000000000000 in ?? ()
#9958 0x0000000000000000 in ?? ()
#9959 0x0000000000000000 in ?? ()
#9960 0x0000000000000000 in ?? ()
#9961 0x0000000000000000 in ?? ()
#9962 0x0000000000000000 in ?? ()
#9963 0x0000000000000000 in ?? ()
#9964 0x0000000000000000 in ?? ()
#9965 0x0000000000000000 in ?? ()
#9966 0x0000000000000000 in ?? ()
#9967 0x0000000000000000 in ?? ()
#9968 0x0000000000000000 in ?? ()
#9969 0x0000000000000000 in ?? ()
#9970 0x0000000000000000 in ?? ()
#9971 0x0000000000000000 in ?? ()
#9972 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---
#9973 0x0000000000000000 in ?? ()
#9974 0x0000000000000000 in ?? ()
#9975 0x0000000000000000 in ?? ()
#9976 0x0000000000000000 in ?? ()
#9977 0x0000000000000000 in ?? ()
#9978 0x0000000000000000 in ?? ()
#9979 0x0000000000000000 in ?? ()
#9980 0x0000000000000000 in ?? ()
#9981 0x0000000000000000 in ?? ()
#9982 0x0000000000000000 in ?? ()
#9983 0x0000000000000000 in ?? ()
#9984 0x0000000000000000 in ?? ()
#9985 0x0000000000000000 in ?? ()
#9986 0x0000000000000000 in ?? ()
#9987 0x0000000000000000 in ?? ()
#9988 0x0000000000000000 in ?? ()
#9989 0x0000000000000000 in ?? ()
#9990 0x0000000000000000 in ?? ()
#9991 0x0000000000000000 in ?? ()
#9992 0x0000000000000000 in ?? ()
#9993 0x0000000000000000 in ?? ()
#9994 0x0000000000000000 in ?? ()
#9995 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---
#9996 0x0000000000000000 in ?? ()
#9997 0x0000000000000000 in ?? ()
#9998 0x0000000000000000 in ?? ()
#9999 0x0000000000000000 in ?? ()
#10000 0x0000000000000000 in ?? ()
#10001 0x0000000000000000 in ?? ()
#10002 0x0000000000000000 in ?? ()
#10003 0x0000000000000000 in ?? ()
#10004 0x0000000000000000 in ?? ()
#10005 0x0000000000000000 in ?? ()
#10006 0x0000000000000000 in ?? ()
#10007 0x0000000000000000 in ?? ()
#10008 0x0000000000000000 in ?? ()
#10009 0x0000000000000000 in ?? ()
#10010 0x0000000000000000 in ?? ()
#10011 0x0000000000000000 in ?? ()
#10012 0x0000000000000000 in ?? ()
#10013 0x0000000000000000 in ?? ()
#10014 0x0000000000000000 in ?? ()
#10015 0x0000000000000000 in ?? ()
#10016 0x0000000000000000 in ?? ()
#10017 0x0000000000000000 in ?? ()
#10018 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---
#10019 0x0000000000000000 in ?? ()
#10020 0x0000000000000000 in ?? ()
#10021 0x0000000000000000 in ?? ()
#10022 0x0000000000000000 in ?? ()
#10023 0x0000000000000000 in ?? ()
#10024 0x0000000000000000 in ?? ()
#10025 0x0000000000000000 in ?? ()
#10026 0x0000000000000000 in ?? ()
#10027 0x0000000000000000 in ?? ()
#10028 0x0000000000000000 in ?? ()
#10029 0x0000000000000000 in ?? ()
#10030 0x0000000000000000 in ?? ()
#10031 0x0000000000000000 in ?? ()
#10032 0x0000000000000000 in ?? ()
#10033 0x0000000000000000 in ?? ()
#10034 0x0000000000000000 in ?? ()
#10035 0x0000000000000000 in ?? ()
#10036 0x0000000000000000 in ?? ()
#10037 0x0000000000000000 in ?? ()
#10038 0x0000000000000000 in ?? ()
#10039 0x0000000000000000 in ?? ()
#10040 0x0000000000000000 in ?? ()
#10041 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---
#10042 0x0000000000000000 in ?? ()
#10043 0x0000000000000000 in ?? ()
#10044 0x0000000000000000 in ?? ()
#10045 0x0000000000000000 in ?? ()
#10046 0x0000000000000000 in ?? ()
#10047 0x0000000000000000 in ?? ()
#10048 0x0000000000000000 in ?? ()
#10049 0x0000000000000000 in ?? ()
#10050 0x0000000000000000 in ?? ()
#10051 0x0000000000000000 in ?? ()
#10052 0x0000000000000000 in ?? ()
#10053 0x0000000000000000 in ?? ()
#10054 0x0000000000000000 in ?? ()
#10055 0x0000000000000000 in ?? ()
#10056 0x0000000000000000 in ?? ()
#10057 0x0000000000000000 in ?? ()
#10058 0x0000000000000000 in ?? ()
#10059 0x0000000000000000 in ?? ()
#10060 0x0000000000000000 in ?? ()
#10061 0x0000000000000000 in ?? ()
#10062 0x0000000000000000 in ?? ()
#10063 0x0000000000000000 in ?? ()
#10064 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---q
q
Quit
(gdb) thread 124
thread 124
[Switching to thread 124 (Thread 183777098080 (LWP 17663))]#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
(gdb) where
where
#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
#1 0x000000000044c067 in TCP_sock::fill_rcvbuffer (this=0x2aeb8846c0)
at TCP_sock.C:1425
#2 0x000000000044c31c in TCP_sock::recv_data (this=0x2aeb8846c0,
buffer=0x2ac9f7f597 "", len=1) at TCP_sock.C:1470
#3 0x00000000004567b6 in SRPC_impl::recv_bytes (this=0x2b2ace77a8,
bs=0x2ac9f7f597 "", len=1) at SRPC_impl.C:280
#4 0x0000000000456aea in SRPC_impl::read_item_code (this=0x2b2ace77a8)
at SRPC_impl.C:368
#5 0x000000000044df28 in SRPC::await_call (this=0x2a9f5bfeb8,
proc_id=@0x2ac9f7f6a8, intf_version=@0x2ac9f7f6ac) at SRPC.C:226
#6 0x0000000000453d36 in LimService::NewConnection (this=0x2a95ef1e00,
srpc=0x2a9f5bfeb8, intfVersion=22, procId=-1) at LimService.C:330
#7 0x0000000000454237 in LimService_Worker (arg=0x2ab8152900)
at LimService.C:405
#8 0x00000000004657dd in ThreadStart_Callback (arg=0x2ab0e00e10)
at ThreadStartPlain.C:58
#9 0x0000000000470849 in GC_start_routine (arg=0x22) at pthread_support.c:1182
#10 0x0000002a9587b919 in start_thread () from /lib64/tls/libpthread.so.0
#11 0x0000002a95b988a3 in thread_start () from /lib64/tls/libc.so.6
#12 0x0000000000000000 in ?? ()
#13 0x0000000000000000 in ?? ()
#14 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---q
q
Quit
(gdb) thread 125
thread 125
[Switching to thread 125 (Thread 183768709472 (LWP 17662))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
(gdb) where
where
#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 ()
from /lib64/tls/libpthread.so.0
#1 0x0000000000461d27 in Basics::cond::wait (this=0x2ab8152a90,
m=@0x2ab8152a20) at Thread.C:122
#2 0x00000000004541fa in LimService_Worker (arg=0x2ab8152a00)
at LimService.C:399
#3 0x00000000004657dd in ThreadStart_Callback (arg=0x2ab0e00f00)
at ThreadStartPlain.C:58
#4 0x0000000000470849 in GC_start_routine (arg=0x2ab8152a94)
at pthread_support.c:1182
#5 0x0000002a9587b919 in start_thread () from /lib64/tls/libpthread.so.0
#6 0x0000002a95b988a3 in thread_start () from /lib64/tls/libc.so.6
#7 0x0000000000000000 in ?? ()
#8 0x0000000000000000 in ?? ()
#9 0x0000000000000000 in ?? ()
#10 0x0000000000000000 in ?? ()
#11 0x0000000000000000 in ?? ()
#12 0x0000000000000000 in ?? ()
#13 0x0000000000000000 in ?? ()
#14 0x0000000000000000 in ?? ()
#15 0x0000000000000000 in ?? ()
#16 0x0000000000000000 in ?? ()
#17 0x0000002a95ce64c0 in _nl_C_locobj () from /lib64/tls/libc.so.6
---Type <return> to continue, or q <return> to quit---q
q
Quit
(gdb) func 4
func 4
Undefined command: "func". Try "help".
(gdb) help stack
help stack
Examining the stack.
The stack is made up of stack frames. Gdb assigns numbers to stack frames
counting from zero for the innermost (currently executing) frame.
At any time gdb identifies one frame as the "selected" frame.
Variable lookups are done with respect to the selected frame.
When the program being debugged stops, gdb selects the innermost frame.
The commands below can be used to select other frames by number or address.
List of commands:
backtrace -- Print backtrace of all stack frames
bt -- Print backtrace of all stack frames
down -- Select and print stack frame called by this one
frame -- Select and print a stack frame
return -- Make selected stack frame return to its caller
select-frame -- Select a stack frame without printing anything
up -- Select and print stack frame that called this one
Type "help" followed by command name for full documentation.
Command name abbreviations are allowed if unambiguous.
(gdb) fr 4
fr 4
#4 0x0000000000470849 in GC_start_routine (arg=0x2ab8152a94)
at pthread_support.c:1182
1182 pthread_support.c: Permission denied.
in pthread_support.c
Current language: auto; currently c
(gdb) th 0
th 0
Ambiguous command "th 0": thbreak, thread.
(gdb) thr 0
thr 0
Thread ID 0 not known.
(gdb) thr 1
thr 1
[Switching to thread 1 (Thread 182903169184 (LWP 32693))]#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
(gdb) where
where
#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
#1 0x000000000044c067 in TCP_sock::fill_rcvbuffer (this=0x2b232eaa20)
at TCP_sock.C:1425
#2 0x000000000044c31c in TCP_sock::recv_data (this=0x2b232eaa20,
buffer=0x7fbfffd5f7 "\v Mn\226*", len=1) at TCP_sock.C:1470
#3 0x00000000004567b6 in SRPC_impl::recv_bytes (this=0x2a966e4d20,
bs=0x7fbfffd5f7 "\v Mn\226*", len=1) at SRPC_impl.C:280
#4 0x0000000000456aea in SRPC_impl::read_item_code (this=0x2a966e4d20)
at SRPC_impl.C:368
#5 0x000000000044df28 in SRPC::await_call (this=0x2a9f5bf6e0,
proc_id=@0x7fbfffd6dc, intf_version=@0x7fbfffd6d8) at SRPC.C:226
#6 0x0000000000453691 in LimService::Run (this=0x2a95ef1e00)
at LimService.C:208
#7 0x0000000000414ccb in ExpCache::Run (this=0x2a95efb5b8) at ExpCache.C:107
#8 0x00000000004187bd in Server (argc=1, argv=0x7fbfffd8e8) at VCache.C:142
#9 0x0000000000418891 in main (argc=1, argv=0x7fbfffd8e8) at VCache.C:159
(gdb) thr 2;where
thr 2;where
Invalid character ';' in expression.
(gdb) def thw
def thw
Type commands for definition of "thw".
End with a line saying just "end".
>thr $1
thr $1
>where
where
>end
end
(gdb) thw 2
thw 2
History has not yet reached $1.
#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
#1 0x000000000044c067 in TCP_sock::fill_rcvbuffer (this=0x2b232eaa20)
at TCP_sock.C:1425
#2 0x000000000044c31c in TCP_sock::recv_data (this=0x2b232eaa20,
buffer=0x7fbfffd5f7 "\v Mn\226*", len=1) at TCP_sock.C:1470
#3 0x00000000004567b6 in SRPC_impl::recv_bytes (this=0x2a966e4d20,
bs=0x7fbfffd5f7 "\v Mn\226*", len=1) at SRPC_impl.C:280
#4 0x0000000000456aea in SRPC_impl::read_item_code (this=0x2a966e4d20)
at SRPC_impl.C:368
#5 0x000000000044df28 in SRPC::await_call (this=0x2a9f5bf6e0,
proc_id=@0x7fbfffd6dc, intf_version=@0x7fbfffd6d8) at SRPC.C:226
#6 0x0000000000453691 in LimService::Run (this=0x2a95ef1e00)
at LimService.C:208
#7 0x0000000000414ccb in ExpCache::Run (this=0x2a95efb5b8) at ExpCache.C:107
#8 0x00000000004187bd in Server (argc=1, argv=0x7fbfffd8e8) at VCache.C:142
#9 0x0000000000418891 in main (argc=1, argv=0x7fbfffd8e8) at VCache.C:159
(gdb) def thw
def thw
Redefine command "thw"? (y or n) y
y
Type commands for definition of "thw".
End with a line saying just "end".
>thr $0
thr $0
>where
where
>end
end
(gdb) thw 2
thw 2
The history is empty.
#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
#1 0x000000000044c067 in TCP_sock::fill_rcvbuffer (this=0x2b232eaa20)
at TCP_sock.C:1425
#2 0x000000000044c31c in TCP_sock::recv_data (this=0x2b232eaa20,
buffer=0x7fbfffd5f7 "\v Mn\226*", len=1) at TCP_sock.C:1470
#3 0x00000000004567b6 in SRPC_impl::recv_bytes (this=0x2a966e4d20,
bs=0x7fbfffd5f7 "\v Mn\226*", len=1) at SRPC_impl.C:280
#4 0x0000000000456aea in SRPC_impl::read_item_code (this=0x2a966e4d20)
at SRPC_impl.C:368
#5 0x000000000044df28 in SRPC::await_call (this=0x2a9f5bf6e0,
proc_id=@0x7fbfffd6dc, intf_version=@0x7fbfffd6d8) at SRPC.C:226
#6 0x0000000000453691 in LimService::Run (this=0x2a95ef1e00)
at LimService.C:208
#7 0x0000000000414ccb in ExpCache::Run (this=0x2a95efb5b8) at ExpCache.C:107
#8 0x00000000004187bd in Server (argc=1, argv=0x7fbfffd8e8) at VCache.C:142
#9 0x0000000000418891 in main (argc=1, argv=0x7fbfffd8e8) at VCache.C:159
(gdb) help def
help def
Define a new command name. Command name is argument.
Definition appears on following lines, one command per line.
End with a line of just "end".
Use the "document" command to give documentation for the new command.
Commands defined in this way may have up to ten arguments.
(gdb) ppp
ppp
Undefined command: "ppp". Try "help".
(gdb) def ppp
def ppp
Type commands for definition of "ppp".
End with a line saying just "end".
>print arg1
print arg1
>end
end
(gdb) ppp blah duh
ppp blah duh
No symbol "arg1" in current context.
(gdb) def ppp
def ppp
Redefine command "ppp"? (y or n) y
y
Type commands for definition of "ppp".
End with a line saying just "end".
>print $arg1
print $arg1
>end
end
(gdb) ppp blah duh
ppp blah duh
No symbol "duh" in current context.
(gdb) ppp blah
ppp blah
Missing argument 1 in user function.
(gdb) ppp "blah", "duh"
ppp "blah", "duh"
$1 = "duh"
(gdb) ppp blah, foo
ppp blah, foo
No symbol "foo" in current context.
(gdb) ppp "blah" "duh"
ppp "blah" "duh"
$2 = "duh"
(gdb) def thw
def thw
Redefine command "thw"? (y or n) y
y
Type commands for definition of "thw".
End with a line saying just "end".
>thr $arg0
thr $arg0
>where
where
>end
end
(gdb) thw 2
thw 2
[Switching to thread 2 (Thread 186706823520 (LWP 9051))]#0 0x0000002a9587fc6b in __lll_mutex_lock_wait ()
from /lib64/tls/libpthread.so.0
#0 0x0000002a9587fc6b in __lll_mutex_lock_wait ()
from /lib64/tls/libpthread.so.0
#1 0x0000000000000000 in ?? ()
#2 0x0000000000000000 in ?? ()
#3 0x0000002a9587cb6c in pthread_mutex_lock () from /lib64/tls/libpthread.so.0
#4 0x0000000000461ddd in Basics::cond::signal (this=0x2a962fd808)
at Thread.C:141
#5 0x000000000040bc3f in CacheS::VToSCache (this=0x2a962fd800,
pfx=@0x2b4b50ecf8, toDelete=0x0) at CacheS.C:1608
#6 0x0000000000410b0a in CacheS_FlushWorker (arg=0x2b4b50ec00)
at CacheS.C:3182
#7 0x00000000004657dd in ThreadStart_Callback (arg=0x2b4bd21c00)
at ThreadStartPlain.C:58
#8 0x0000000000470849 in GC_start_routine (arg=0x2a962fd808)
at pthread_support.c:1182
#9 0x0000002a9587b919 in start_thread () from /lib64/tls/libpthread.so.0
#10 0x0000002a95b988a3 in thread_start () from /lib64/tls/libc.so.6
#11 0x0000000000000000 in ?? ()
#12 0x0000000000000000 in ?? ()
#13 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---q
q
Quit
(gdb) thw 3
thw 3
[Switching to thread 3 (Thread 186577062240 (LWP 10608))]#0 0x0000002a9587fc6b in __lll_mutex_lock_wait () from /lib64/tls/libpthread.so.0
#0 0x0000002a9587fc6b in __lll_mutex_lock_wait ()
from /lib64/tls/libpthread.so.0
#1 0x0000000000000000 in ?? ()
#2 0x0000000000000000 in ?? ()
#3 0x0000002a9587cb6c in pthread_mutex_lock () from /lib64/tls/libpthread.so.0
#4 0x0000000000461ddd in Basics::cond::signal (this=0x2a962fd808)
at Thread.C:141
#5 0x000000000040bc3f in CacheS::VToSCache (this=0x2a962fd800,
pfx=@0x2ab79a09f8, toDelete=0x0) at CacheS.C:1608
#6 0x0000000000410b0a in CacheS_FlushWorker (arg=0x2ab79a0900)
at CacheS.C:3182
#7 0x00000000004657dd in ThreadStart_Callback (arg=0x2ab79a0400)
at ThreadStartPlain.C:58
#8 0x0000000000470849 in GC_start_routine (arg=0x2a962fd808)
at pthread_support.c:1182
#9 0x0000002a9587b919 in start_thread () from /lib64/tls/libpthread.so.0
#10 0x0000002a95b988a3 in thread_start () from /lib64/tls/libc.so.6
#11 0x0000000000000000 in ?? ()
#12 0x0000000000000000 in ?? ()
#13 0x0000000000000000 in ?? ()
#14 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---q
q
Quit
(gdb) thw 4
thw 4
[Switching to thread 4 (Thread 186568673632 (LWP 9943))]#0 0x0000002a9587fc6b in __lll_mutex_lock_wait () from /lib64/tls/libpthread.so.0
#0 0x0000002a9587fc6b in __lll_mutex_lock_wait ()
from /lib64/tls/libpthread.so.0
#1 0x0000000000000000 in ?? ()
#2 0x0000000000000000 in ?? ()
#3 0x0000002a9587cb6c in pthread_mutex_lock () from /lib64/tls/libpthread.so.0
#4 0x0000000000461ddd in Basics::cond::signal (this=0x2a962fd808)
at Thread.C:141
#5 0x000000000040bc3f in CacheS::VToSCache (this=0x2a962fd800,
pfx=@0x2abd04f4f8, toDelete=0x0) at CacheS.C:1608
#6 0x0000000000410b0a in CacheS_FlushWorker (arg=0x2abd04f400)
at CacheS.C:3182
#7 0x00000000004657dd in ThreadStart_Callback (arg=0x2abd04f300)
at ThreadStartPlain.C:58
#8 0x0000000000470849 in GC_start_routine (arg=0x2a962fd808)
at pthread_support.c:1182
#9 0x0000002a9587b919 in start_thread () from /lib64/tls/libpthread.so.0
#10 0x0000002a95b988a3 in thread_start () from /lib64/tls/libc.so.6
#11 0x0000000000000000 in ?? ()
#12 0x0000000000000000 in ?? ()
#13 0x0000000000000000 in ?? ()
#14 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---q
q
Quit
(gdb) thw 5
thw 5
[Switching to thread 5 (Thread 186543245664 (LWP 23172))]#0 0x0000002a9587fc6b in __lll_mutex_lock_wait () from /lib64/tls/libpthread.so.0
#0 0x0000002a9587fc6b in __lll_mutex_lock_wait ()
from /lib64/tls/libpthread.so.0
#1 0x0000000000000000 in ?? ()
#2 0x0000000000000000 in ?? ()
#3 0x0000002a9587cb6c in pthread_mutex_lock () from /lib64/tls/libpthread.so.0
#4 0x0000000000461ddd in Basics::cond::signal (this=0x2a962fd808)
at Thread.C:141
#5 0x000000000040bc3f in CacheS::VToSCache (this=0x2a962fd800,
pfx=@0x2a9b3cb2f8, toDelete=0x0) at CacheS.C:1608
#6 0x0000000000410b0a in CacheS_FlushWorker (arg=0x2a9b3cb200)
at CacheS.C:3182
#7 0x00000000004657dd in ThreadStart_Callback (arg=0x2aad590f00)
at ThreadStartPlain.C:58
#8 0x0000000000470849 in GC_start_routine (arg=0x2a962fd808)
at pthread_support.c:1182
#9 0x0000002a9587b919 in start_thread () from /lib64/tls/libpthread.so.0
#10 0x0000002a95b988a3 in thread_start () from /lib64/tls/libc.so.6
#11 0x0000000000000000 in ?? ()
#12 0x0000000000000000 in ?? ()
#13 0x0000000000000000 in ?? ()
#14 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---q
q
Quit
(gdb) thw 6
thw 6
[Switching to thread 6 (Thread 186534857056 (LWP 12269))]#0 0x0000002a9587fc6b in __lll_mutex_lock_wait () from /lib64/tls/libpthread.so.0
#0 0x0000002a9587fc6b in __lll_mutex_lock_wait ()
from /lib64/tls/libpthread.so.0
#1 0x0000000000000000 in ?? ()
#2 0x0000000000000000 in ?? ()
#3 0x0000002a9587cb6c in pthread_mutex_lock () from /lib64/tls/libpthread.so.0
#4 0x0000000000461ddd in Basics::cond::signal (this=0x2a962fd808)
at Thread.C:141
#5 0x000000000040bc3f in CacheS::VToSCache (this=0x2a962fd800,
pfx=@0x2b05e542f8, toDelete=0x0) at CacheS.C:1608
#6 0x0000000000410b0a in CacheS_FlushWorker (arg=0x2b05e54200)
at CacheS.C:3182
#7 0x00000000004657dd in ThreadStart_Callback (arg=0x2b297e5c00)
at ThreadStartPlain.C:58
#8 0x0000000000470849 in GC_start_routine (arg=0x2a962fd808)
at pthread_support.c:1182
#9 0x0000002a9587b919 in start_thread () from /lib64/tls/libpthread.so.0
#10 0x0000002a95b988a3 in thread_start () from /lib64/tls/libc.so.6
#11 0x0000000000000000 in ?? ()
#12 0x0000000000000000 in ?? ()
#13 0x0000000000000000 in ?? ()
#14 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---q
q
Quit
(gdb) thw 7
q
thw 7
[Switching to thread 7 (Thread 186526468448 (LWP 645))]#0 0x0000002a9587fc6b in __lll_mutex_lock_wait () from /lib64/tls/libpthread.so.0
#0 0x0000002a9587fc6b in __lll_mutex_lock_wait ()
from /lib64/tls/libpthread.so.0
#1 0x0000000000000000 in ?? ()
#2 0x0000000000000000 in ?? ()
#3 0x0000002a9587cb6c in pthread_mutex_lock () from /lib64/tls/libpthread.so.0
#4 0x0000000000461ddd in Basics::cond::signal (this=0x2a962fd808)
at Thread.C:141
#5 0x000000000040bc3f in CacheS::VToSCache (this=0x2a962fd800,
pfx=@0x2afc83aff8, toDelete=0x0) at CacheS.C:1608
#6 0x0000000000410b0a in CacheS_FlushWorker (arg=0x2afc83af00)
at CacheS.C:3182
#7 0x00000000004657dd in ThreadStart_Callback (arg=0x2b259ed500)
at ThreadStartPlain.C:58
#8 0x0000000000470849 in GC_start_routine (arg=0x2a962fd808)
at pthread_support.c:1182
#9 0x0000002a9587b919 in start_thread () from /lib64/tls/libpthread.so.0
#10 0x0000002a95b988a3 in thread_start () from /lib64/tls/libc.so.6
#11 0x0000000000000000 in ?? ()
#12 0x0000000000000000 in ?? ()
#13 0x0000000000000000 in ?? ()
#14 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---q
Quit
(gdb) thw 8
q
thw 8
[Switching to thread 8 (Thread 186400639328 (LWP 28856))]#0 0x0000002a9587fc6b in __lll_mutex_lock_wait () from /lib64/tls/libpthread.so.0
#0 0x0000002a9587fc6b in __lll_mutex_lock_wait ()
from /lib64/tls/libpthread.so.0
#1 0x0000002b372c03f8 in ?? ()
#2 0x0000002a95e8f000 in ?? ()
#3 0x0000002a9587cb6c in pthread_mutex_lock () from /lib64/tls/libpthread.so.0
#4 0x0000002b372c03f8 in ?? ()
#5 0x0000002b371fcee0 in ?? ()
#6 0x0000002a9587b850 in __nptl_deallocate_tsd ()
from /lib64/tls/libpthread.so.0
#7 0x0000002b665803d0 in ?? ()
#8 0x0000000000420c34 in SMultiPKFile::PrepareForRewrite (pfx=@0x461c4b,
ifs=@0x2b66580490, hdr=@0x410f5d) at SMultiPKFile.C:264
#9 0x000000000040bed3 in CacheS::VToSCache (this=0x2a962fd800,
pfx=@0x2b372c03f8, toDelete=0x0) at CacheS.C:1670
#10 0x0000000000410b0a in CacheS_FlushWorker (arg=0x2b372c0300)
at CacheS.C:3182
#11 0x00000000004657dd in ThreadStart_Callback (arg=0x2ac0c39200)
at ThreadStartPlain.C:58
#12 0x0000000000470849 in GC_start_routine (arg=0x2a962fd808)
at pthread_support.c:1182
#13 0x0000002a9587b919 in start_thread () from /lib64/tls/libpthread.so.0
---Type <return> to continue, or q <return> to quit---q
Quit
(gdb) thw 9
q
thw 9
[Switching to thread 9 (Thread 186392250720 (LWP 5663))]#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
#0 0x0000002a9587ff3f in __read_nocancel () from /lib64/tls/libpthread.so.0
#1 0x000000000044c067 in TCP_sock::fill_rcvbuffer (this=0x2ac39856c0)
at TCP_sock.C:1425
#2 0x000000000044c31c in TCP_sock::recv_data (this=0x2ac39856c0,
buffer=0x2b65d80597 "", len=1) at TCP_sock.C:1470
#3 0x00000000004567b6 in SRPC_impl::recv_bytes (this=0x2ab620cee0,
bs=0x2b65d80597 "", len=1) at SRPC_impl.C:280
#4 0x0000000000456aea in SRPC_impl::read_item_code (this=0x2ab620cee0)
at SRPC_impl.C:368
#5 0x000000000044df28 in SRPC::await_call (this=0x2a9f5bf8d0,
proc_id=@0x2b65d806a8, intf_version=@0x2b65d806ac) at SRPC.C:226
#6 0x0000000000453d36 in LimService::NewConnection (this=0x2a95ef1e00,
srpc=0x2a9f5bf8d0, intfVersion=22, procId=-1) at LimService.C:330
#7 0x0000000000454237 in LimService_Worker (arg=0x2b3dc4c300)
at LimService.C:405
#8 0x00000000004657dd in ThreadStart_Callback (arg=0x2aaf13e000)
at ThreadStartPlain.C:58
#9 0x0000000000470849 in GC_start_routine (arg=0x1b) at pthread_support.c:1182
#10 0x0000002a9587b919 in start_thread () from /lib64/tls/libpthread.so.0
#11 0x0000002a95b988a3 in thread_start () from /lib64/tls/libc.so.6
#12 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---q
Quit
(gdb) thw 10
q
thw 10
[Switching to thread 10 (Thread 186383862112 (LWP 5660))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 ()
from /lib64/tls/libpthread.so.0
#1 0x0000000000461d27 in Basics::cond::wait (this=0x2b3dc4c490,
m=@0x2b3dc4c420) at Thread.C:122
#2 0x00000000004541fa in LimService_Worker (arg=0x2b3dc4c400)
at LimService.C:399
#3 0x00000000004657dd in ThreadStart_Callback (arg=0x2aaf13e0f0)
at ThreadStartPlain.C:58
#4 0x0000000000470849 in GC_start_routine (arg=0x2b3dc4c494)
at pthread_support.c:1182
#5 0x0000002a9587b919 in start_thread () from /lib64/tls/libpthread.so.0
#6 0x0000002a95b988a3 in thread_start () from /lib64/tls/libc.so.6
#7 0x0000000000000000 in ?? ()
#8 0x0000000000000000 in ?? ()
#9 0x0000000000000000 in ?? ()
#10 0x0000000000000000 in ?? ()
#11 0x0000000000000000 in ?? ()
#12 0x0000000000000000 in ?? ()
#13 0x0000000000000000 in ?? ()
#14 0x0000000000000000 in ?? ()
#15 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---
q
Quit
(gdb)
[Switching to thread 10 (Thread 186383862112 (LWP 5660))]#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/tls/libpthread.so.0
#0 0x0000002a9587d89d in pthread_cond_wait@@GLIBC_2.3.2 ()
from /lib64/tls/libpthread.so.0
#1 0x0000000000461d27 in Basics::cond::wait (this=0x2b3dc4c490,
m=@0x2b3dc4c420) at Thread.C:122
#2 0x00000000004541fa in LimService_Worker (arg=0x2b3dc4c400)
at LimService.C:399
#3 0x00000000004657dd in ThreadStart_Callback (arg=0x2aaf13e0f0)
at ThreadStartPlain.C:58
#4 0x0000000000470849 in GC_start_routine (arg=0x2b3dc4c494)
at pthread_support.c:1182
#5 0x0000002a9587b919 in start_thread () from /lib64/tls/libpthread.so.0
#6 0x0000002a95b988a3 in thread_start () from /lib64/tls/libc.so.6
#7 0x0000000000000000 in ?? ()
#8 0x0000000000000000 in ?? ()
#9 0x0000000000000000 in ?? ()
#10 0x0000000000000000 in ?? ()
#11 0x0000000000000000 in ?? ()
#12 0x0000000000000000 in ?? ()
#13 0x0000000000000000 in ?? ()
#14 0x0000000000000000 in ?? ()
#15 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---q
q
Quit
(gdb) thw 8
thw 8
[Switching to thread 8 (Thread 186400639328 (LWP 28856))]#0 0x0000002a9587fc6b in __lll_mutex_lock_wait () from /lib64/tls/libpthread.so.0
#0 0x0000002a9587fc6b in __lll_mutex_lock_wait ()
from /lib64/tls/libpthread.so.0
#1 0x0000002b372c03f8 in ?? ()
#2 0x0000002a95e8f000 in ?? ()
#3 0x0000002a9587cb6c in pthread_mutex_lock () from /lib64/tls/libpthread.so.0
#4 0x0000002b372c03f8 in ?? ()
#5 0x0000002b371fcee0 in ?? ()
#6 0x0000002a9587b850 in __nptl_deallocate_tsd ()
from /lib64/tls/libpthread.so.0
#7 0x0000002b665803d0 in ?? ()
#8 0x0000000000420c34 in SMultiPKFile::PrepareForRewrite (pfx=@0x461c4b,
ifs=@0x2b66580490, hdr=@0x410f5d) at SMultiPKFile.C:264
#9 0x000000000040bed3 in CacheS::VToSCache (this=0x2a962fd800,
pfx=@0x2b372c03f8, toDelete=0x0) at CacheS.C:1670
#10 0x0000000000410b0a in CacheS_FlushWorker (arg=0x2b372c0300)
at CacheS.C:3182
#11 0x00000000004657dd in ThreadStart_Callback (arg=0x2ac0c39200)
at ThreadStartPlain.C:58
#12 0x0000000000470849 in GC_start_routine (arg=0x2a962fd808)
at pthread_support.c:1182
#13 0x0000002a9587b919 in start_thread () from /lib64/tls/libpthread.so.0
---Type <return> to continue, or q <return> to quit---q
q
Quit
(gdb) thr 261
thr 261
[Switching to thread 261 (Thread 1082128736 (LWP 32699))]#0 0x0000002a9587fc6b in __lll_mutex_lock_wait () from /lib64/tls/libpthread.so.0
(gdb) where
where
#0 0x0000002a9587fc6b in __lll_mutex_lock_wait ()
from /lib64/tls/libpthread.so.0
#1 0x0000000000000000 in ?? ()
#2 0x00000000451b2ef3 in ?? ()
#3 0x0000002a9587cb6c in pthread_mutex_lock () from /lib64/tls/libpthread.so.0
#4 0x000000000000007c in ?? ()
#5 0x0000002a9587d750 in pthread_cond_destroy@@GLIBC_2.3.2 ()
from /lib64/tls/libpthread.so.0
#6 0x00000000407ff5f0 in ?? ()
#7 0x00000000005af960 in dummyMu ()
#8 0x0000000000000000 in ?? ()
#9 0x0000000000000003 in ?? ()
#10 0x0000002a9587b850 in __nptl_deallocate_tsd ()
from /lib64/tls/libpthread.so.0
#11 0x0000000000461d83 in Basics::cond::timedwait (this=0x2a962fd808,
m=@0x451b2ee5, abstime=0x461c4b) at Thread.C:128
#12 0x000000000041a313 in Leases::Expire (this=0x2a962fefc8) at Leases.C:85
#13 0x000000000041a017 in Leases_TimeoutProc (arg=0x2a962fefc8) at Leases.C:44
#14 0x00000000004657dd in ThreadStart_Callback (arg=0x2a95eebd00)
at ThreadStartPlain.C:58
#15 0x0000000000470849 in GC_start_routine (arg=0x2a962fd808)
at pthread_support.c:1182
#16 0x0000002a9587b919 in start_thread () from /lib64/tls/libpthread.so.0
---Type <return> to continue, or q <return> to quit---z
z
#17 0x0000002a95b988a3 in thread_start () from /lib64/tls/libc.so.6
#18 0x0000000000000000 in ?? ()
#19 0x0000000000000000 in ?? ()
#20 0x0000000000000000 in ?? ()
#21 0x0000000000000000 in ?? ()
#22 0x0000000000000000 in ?? ()
#23 0x0000000000000000 in ?? ()
#24 0x0000000000000000 in ?? ()
#25 0x0000000000000000 in ?? ()
#26 0x0000000000000000 in ?? ()
#27 0x0000000000000000 in ?? ()
#28 0x0000002a95ce64c0 in _nl_C_locobj () from /lib64/tls/libc.so.6
#29 0x00000000407ffdc0 in ?? ()
#30 0x0000000000000004 in ?? ()
#31 0x0000000000000000 in ?? ()
#32 0x0000000000000000 in ?? ()
#33 0x0000000000000000 in ?? ()
#34 0x0000000000000000 in ?? ()
#35 0x0000000000000000 in ?? ()
#36 0x0000000000000000 in ?? ()
#37 0x00000000407ff960 in ?? ()
#38 0x0000000000631768 in ?? ()
#39 0x00000000407ff960 in ?? ()
---Type <return> to continue, or q <return> to quit---q
q
Quit
(gdb) thr 262
thr 262
Thread ID 262 not known.
(gdb) help cores
help cores
Undefined command: "cores". Try "help".
(gdb) help core
help core
Use FILE as core dump for examining memory and registers.
No arg means have no core file. This command has been superseded by the
`target core' and `detach' commands.
(gdb) help write
help write
Undefined command: "write". Try "help".
(gdb) help gcore
help gcore
Save a core file with the current state of the debugged process.
Argument is optional filename. Default filename is 'core.<process_id>'.
(gdb) thread
thread
[Current thread is 261 (Thread 1082128736 (LWP 32699))]
(gdb) pwd
pwd
Working directory /nfs/sc/home/jvkumpf.
(gdb) !df -k /nfs/sc/home/jvkumpf
!df -k /nfs/sc/home/jvkumpf
Undefined command: "". Try "help".
(gdb) ! df -k /nfs/sc/home/jvkumpf
! df -k /nfs/sc/home/jvkumpf
Undefined command: "". Try "help".
(gdb)gcore
gcore
Failed to open 'core.32693' for output.
(gdb) cd vadmin
cd vadmin
vadmin: Permission denied.
(gdb) gcore /nfs/sc/home/jvkumpf/vadmin/
gcore /nfs/sc/home/jvkumpf/vadmin/
Failed to open '/nfs/sc/home/jvkumpf/vadmin/' for output.
(gdb) gcore /nfs/sc/home/jvkumpf/vadmin/core.32693
gcore /nfs/sc/home/jvkumpf/vadmin/core.32693
Failed to open '/nfs/sc/home/jvkumpf/vadmin/core.32693' for output.
(gdb) cd /nfs/user/home/vadmin/vcache_cores
cd /nfs/user/home/vadmin/vcache_cores
Working directory /nfs/user/home/vadmin/vcache_cores.
(gdb) gcore
gcore
warning: Failed to write corefile contents (No space left on device).
warning: Failed to write corefile contents (No space left on device).
warning: Failed to write corefile contents (No space left on device).
warning: Failed to write corefile contents (No space left on device).
warning: Failed to write corefile contents (No space left on device).
warning: Failed to write corefile contents (No space left on device).
warning: Failed to write corefile contents (No space left on device).
warning: Failed to write corefile contents (No space left on device).
warning: Failed to write corefile contents (No space left on device).
warning: Failed to write corefile contents (No space left on device).
warning: Failed to write corefile contents (No space left on device).
warning: Failed to write corefile contents (No space left on device).
warning: Failed to write corefile contents (No space left on device).
warning: Failed to write corefile contents (No space left on device).
warning: Failed to write corefile contents (No space left on device).
warning: Failed to write corefile contents (No space left on device).
warning: Failed to write corefile contents (No space left on device).
warning: Failed to write corefile contents (No space left on device).
warning: Failed to write corefile contents (No space left on device).
warning: Failed to write corefile contents (No space left on device).
warning: Failed to write corefile contents (No space left on device).
warning: Failed to write corefile contents (No space left on device).
warning: Failed to write corefile contents (No space left on device).
Saved corefile core.32693
(gdb) cd /tmp_proj/vadmin
cd /tmp_proj/vadmin
Working directory /tmp_proj/vadmin
(canonically /tmp/tmp_proj/vadmin).
(gdb) gcore
gcore
Failed to open 'core.32693' for output.
(gdb) gcore
gcore
Saved corefile core.32693
(gdb)