project-base/server-skynet-source-3rd-jemalloc
2
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
server-skynet-source-3rd-je.../include/jemalloc/internal
History
Dave Watson b23336af96 mutex: fix trylock spin wait contention 
If there are 3 or more threads spin-waiting on the same mutex,
there will be excessive exclusive cacheline contention because
pthread_trylock() immediately tries to CAS in a new value, instead
of first checking if the lock is locked.

This diff adds a 'locked' hint flag, and we will only spin wait
without trylock()ing while set.  I don't know of any other portable
way to get the same behavior as pthread_mutex_lock().

This is pretty easy to test via ttest, e.g.

./ttest1 500 3 10000 1 100

Throughput is nearly 3x as fast.

This blames to the mutex profiling changes, however, we almost never
have 3 or more threads contending in properly configured production
workloads, but still worth fixing.
2018-11-28 15:17:02 -08:00
..
arena_externs.h
Add extents information to mallocstats output
2018-08-02 10:16:06 -07:00
arena_inlines_a.h
Control idump and gdump with prof_active.
2018-04-09 16:35:14 -07:00
arena_inlines_b.h
drop bump_empty_alloc option. Size class lookup support used instead.
2018-10-17 08:50:58 -07:00
arena_stats.h
Add stats for the size of extent_avail heap
2018-08-02 10:16:06 -07:00
arena_structs_a.h
Header refactoring: bitmap - unify and remove from catchall.
2017-04-24 10:33:21 -07:00
arena_structs_b.h
Add stats for the size of extent_avail heap
2018-08-02 10:16:06 -07:00
arena_types.h
Hide size class computation behind a layer of indirection.
2018-07-12 20:53:06 -07:00
assert.h
Disentangle assert and util
2017-03-06 15:08:43 -08:00
atomic_c11.h
Introduce a backport of C11 atomics
2017-03-03 13:40:59 -08:00
atomic_gcc_atomic.h
Insert not_reached after an exhaustive switch
2017-03-06 15:08:43 -08:00
atomic_gcc_sync.h
Restrict lwsync to powerpc64 only
2018-10-24 11:18:55 -07:00
atomic_msvc.h
Introduce a backport of C11 atomics
2017-03-03 13:40:59 -08:00
atomic.h
TSD: Make all state access happen through a function.
2018-05-18 11:43:03 -07:00
background_thread_externs.h
Fall back to the default pthread_create if RTLD_NEXT fails.
2018-06-28 13:18:21 -07:00
background_thread_inlines.h
Fix background thread index issues with max_background_threads.
2018-05-15 12:25:23 -07:00
background_thread_structs.h
Set the default number of background threads to 4.
2018-11-16 09:35:12 -08:00
base_externs.h
Add stats for metadata_thp.
2017-08-30 16:47:32 -07:00
base_inlines.h
Change opt.metadata_thp to [disabled,auto,always].
2017-08-30 16:47:32 -07:00
base_structs.h
Hide size class computation behind a layer of indirection.
2018-07-12 20:53:06 -07:00
base_types.h
metadata_thp: auto mode adjustment for a0.
2017-11-01 13:52:06 -07:00
bin_stats.h
Split up and standardize naming of stats code.
2017-12-18 16:29:10 -08:00
bin.h
Hide size class computation behind a layer of indirection.
2018-07-12 20:53:06 -07:00
bit_util.h
Add a fastpath for arena_slab_reg_alloc_batch
2018-11-14 07:09:11 -08:00
bitmap.h
Hide size class computation behind a layer of indirection.
2018-07-12 20:53:06 -07:00
cache_bin.h
refactor tcache_dalloc_small
2018-11-12 13:20:37 -08:00
ckh.h
Header refactoring: tsd - cleanup and dependency breaking.
2017-05-01 10:49:56 -07:00
ctl.h
Add extents information to mallocstats output
2018-08-02 10:16:06 -07:00
div.h
Add the div module, which allows fast division by dynamic values.
2017-12-21 14:25:43 -08:00
emitter.h
Small refactoring of emitter
2018-08-01 13:27:11 -07:00
extent_dss.h
Header refactoring: unify and de-catchall extent_dss.
2017-05-31 13:08:45 -07:00
extent_externs.h
Add extents information to mallocstats output
2018-08-02 10:16:06 -07:00
extent_inlines.h
add extent_nfree_sub
2018-11-14 07:09:11 -08:00
extent_mmap.h
Header refactoring: unify and de-catchall extent_mmap module.
2017-05-31 13:08:45 -07:00
extent_structs.h
Add extents information to mallocstats output
2018-08-02 10:16:06 -07:00
extent_types.h
Hide size class computation behind a layer of indirection.
2018-07-12 20:53:06 -07:00
hash.h
Clean compilation -Wextra
2018-07-09 21:40:42 -07:00
hook.h
Hooks: Protect against reentrancy.
2018-05-18 11:43:03 -07:00
jemalloc_internal_decls.h
Make use of pthread_set_name_np(3) on FreeBSD.
2018-10-24 10:06:37 -07:00
jemalloc_internal_defs.h.in
Deprecate OSSpinLock.
2018-11-14 08:44:05 -08:00
jemalloc_internal_externs.h
Hide size class computation behind a layer of indirection.
2018-07-12 20:53:06 -07:00
jemalloc_internal_includes.h
Header refactoring: unify and de-catchall mutex_pool.
2017-05-31 13:08:45 -07:00
jemalloc_internal_inlines_a.h
Hide size class computation behind a layer of indirection.
2018-07-12 20:53:06 -07:00
jemalloc_internal_inlines_b.h
Refactor arena_is_auto.
2018-06-29 10:35:02 -07:00
jemalloc_internal_inlines_c.h
drop bump_empty_alloc option. Size class lookup support used instead.
2018-10-17 08:50:58 -07:00
jemalloc_internal_macros.h
Suppress -Wmissing-field-initializer warning only for compilers with buggy implementation
2018-07-10 13:13:36 -07:00
jemalloc_internal_types.h
Move quantum detection into its own file.
2018-07-12 20:53:06 -07:00
jemalloc_preamble.h.in
Deprecate OSSpinLock.
2018-11-14 08:44:05 -08:00
large_externs.h
Add logging for sampled allocations
2018-08-01 13:27:11 -07:00
log.h
Logging: capitalize log macro.
2017-10-02 20:44:43 -07:00
malloc_io.h
Fix type warning on Windows.
2018-04-09 16:50:30 -07:00
mutex_pool.h
Header refactoring: unify and de-catchall mutex_pool.
2017-05-31 13:08:45 -07:00
mutex_prof.h
Stats printing: Move global mutex stats to use emitter.
2018-03-09 11:47:17 -08:00
mutex.h
mutex: fix trylock spin wait contention
2018-11-28 15:17:02 -08:00
nstime.h
Add background thread related stats.
2017-05-23 12:26:20 -07:00
pages.h
Add opt.thp which allows explicit hugepage usage.
2018-03-08 13:08:06 -08:00
ph.h
Add any() and remove_any() to ph.
2017-03-07 10:25:33 -08:00
private_namespace.sh
Automatically generate private symbol name mangling macros.
2017-05-11 23:06:54 -07:00
private_symbols.sh
Automatically generate private symbol name mangling macros.
2017-05-11 23:06:54 -07:00
prng.h
Header refactoring: prng module - remove from the catchall and unify.
2017-04-24 10:33:21 -07:00
prof_externs.h
Add unit tests for logging
2018-08-01 13:27:11 -07:00
prof_inlines_a.h
SC: Make some key size classes static.
2018-07-12 20:53:06 -07:00
prof_inlines_b.h
prof: Fix memory regression
2018-10-23 12:39:57 -07:00
prof_structs.h
move bytes until sample to tsd. Fastpath allocation does not need
2018-10-15 08:24:12 -07:00
prof_types.h
Convert arena->prof_accumbytes synchronization to atomics.
2017-02-16 09:39:46 -08:00
public_namespace.sh
Replace tabs following #define with spaces.
2017-01-20 21:45:53 -08:00
public_unnamespace.sh
Fix name mangling for stress tests.
2014-01-16 17:38:01 -08:00
ql.h
Header refactoring: break out qr.h dependencies
2017-04-11 11:52:30 -07:00
qr.h
Replace tabs following #define with spaces.
2017-01-20 21:45:53 -08:00
quantum.h
Move quantum detection into its own file.
2018-07-12 20:53:06 -07:00
rb.h
Header refactoring: break out rb.h dependencies
2017-04-11 11:52:30 -07:00
rtree_tsd.h
Clean compilation -Wextra
2018-07-09 21:40:42 -07:00
rtree.h
rtree: add rtree_szind_slab_read_fast
2018-11-12 13:20:37 -08:00
sc.h
Fix comment on SC_NPSIZES.
2018-08-02 10:16:06 -07:00
seq.h
Add the Seq module, a simple seqlock implementation.
2018-05-18 11:43:03 -07:00
smoothstep.h
Cleanup smoothstep.sh / .h.
2017-05-25 16:52:10 -07:00
smoothstep.sh
Cleanup smoothstep.sh / .h.
2017-05-25 16:52:10 -07:00
spin.h
Power: disable the CPU_SPINWAIT macro.
2017-10-04 18:37:23 -07:00
stats.h
Add extents information to mallocstats output
2018-08-02 10:16:06 -07:00
sz.h
sz: Support 0 size in size2index lookup/compute
2018-10-17 08:50:58 -07:00
tcache_externs.h
Hide size class computation behind a layer of indirection.
2018-07-12 20:53:06 -07:00
tcache_inlines.h
Fix tcache_flush (follow up cd2931a).
2018-11-13 08:54:09 -08:00
tcache_structs.h
Hide size class computation behind a layer of indirection.
2018-07-12 20:53:06 -07:00
tcache_types.h
Fix tcache_flush (follow up cd2931a).
2018-11-13 08:54:09 -08:00
test_hooks.h
Rename hooks module to test_hooks.
2018-05-18 11:43:03 -07:00
ticker.h
ticker: add ticker_trytick
2018-10-18 08:32:19 -07:00
tsd_generic.h
Clean compilation -Wextra
2018-07-09 21:40:42 -07:00
tsd_malloc_thread_cleanup.h
remove malloc_init() off the fastpath
2018-10-15 10:11:08 -07:00
tsd_tls.h
remove malloc_init() off the fastpath
2018-10-15 10:11:08 -07:00
tsd_types.h
Header refactoring: tsd - cleanup and dependency breaking.
2017-05-01 10:49:56 -07:00
tsd_win.h
Header refactoring: tsd - cleanup and dependency breaking.
2017-05-01 10:49:56 -07:00
tsd.h
restrict bytes_until_sample to int64_t. This allows optimal asm
2018-10-15 08:24:12 -07:00
util.h
Remove --disable-cc-silence.
2017-04-24 15:02:45 -07:00
witness.h
Add logging for sampled allocations
2018-08-01 13:27:11 -07:00