Qi Wang
93084cdc89
Ensure page alignment on extent_alloc.
...
This is discovered and suggested by @jasone in #1468 . When custom extent hooks
are in use, we should ensure page alignment on the extent alloc path, instead of
relying on the user hooks to do so.
2019-04-04 13:49:37 -07:00
Yinan Zhang
9aab3f2be0
Add memory utilization analytics to mallctl
...
The analytics tool is put under experimental.utilization namespace in
mallctl. Input is one pointer or an array of pointers and the output
is a list of memory utilization statistics.
2019-04-04 13:48:39 -07:00
Qi Wang
b0b3e49a54
Merge branch 'dev'
2019-04-02 17:50:42 -07:00
Qi Wang
f7489dc8f1
Update Changelog for 5.2.0.
2019-04-02 17:40:42 -07:00
Qi Wang
978a7a21ae
Use iallocztm instead of ialloc in prof_log functions.
...
Explicitly use iallocztm for internal allocations. ialloc could trigger arena
creation, which may cause lock order reversal (narenas_mtx and log_mtx).
2019-04-02 16:53:00 -07:00
Qi Wang
6fe11633b0
Fix the binshard unit test.
...
The test attempts to trigger usage of multiple sharded bins, which percpu_arena
makes it less reliable.
2019-04-02 16:53:00 -07:00
Qi Wang
064d6e570e
Tweak the wording about oversize_threshold.
2019-04-01 10:36:29 -07:00
Qi Wang
0101d5ebef
Avoid check_min for opt_lg_extent_max_active_fit.
...
This fixes a compiler warning.
2019-03-29 15:56:53 -07:00
Qi Wang
59d9891948
Add the missing unlock in the error path of extent_register.
2019-03-29 15:56:53 -07:00
Qi Wang
ce03e4c7b8
Document opt.oversize_threshold.
2019-03-29 11:55:05 -07:00
Qi Wang
788a657cee
Allow low values of oversize_threshold to disable the feature.
...
We should allow a way to easily disable the feature (e.g. not reserving the
arena id at all).
2019-03-29 11:33:00 -07:00
Qi Wang
a4d017f5e5
Output message before aborting on tcache size-matching check.
2019-03-29 11:33:00 -07:00
Qi Wang
fb56766ca9
Eagerly purge oversized merged extents.
...
This change improves memory usage slightly, at virtually no CPU cost.
2019-03-14 17:34:55 -07:00
Qi Wang
f6c30cbafa
Remove some unused comments.
2019-03-14 17:34:55 -07:00
Qi Wang
b804d0f019
Fallback to 32-bit when 8-bit atomics are missing for TSD.
...
When it happens, this might cause a slowdown on the fast path operations.
However such case is very rare.
2019-03-09 12:52:06 -08:00
Qi Wang
06f0850427
Detect if 8-bit atomics are available.
...
In some rare cases (older compiler, e.g. gcc 4.2 w/ MIPS), 8-bit atomics might
be unavailable. Detect such cases so that we can workaround.
2019-03-09 12:52:06 -08:00
Jason Evans
14d3686c9f
Do not use #pragma GCC diagnostic with gcc < 4.6.
...
This regression was introduced by
3d29d11ac2
2019-03-09 12:10:30 -08:00
Qi Wang
ac24ffb21e
Fix a syntax error in configure.ac
...
Introduced in e13400c919
2019-03-04 10:50:17 -08:00
Jason Evans
775fe302a7
Remove JE_FORCE_SYNC_COMPARE_AND_SWAP_[48].
...
These macros have been unused since
d4ac7582f3
2019-02-22 14:22:16 -08:00
Dave Rigby
cbdb1807ce
Stringify tls_callback linker directive
...
Proposed fix for #1444 - ensure that `tls_callback` in the `#pragma comment(linker)`directive gets the same prefix added as it does i the C declaration.
2019-02-22 12:43:35 -08:00
Qi Wang
18450d0abe
Guard libgcc unwind init with opt_prof.
...
Only triggers libgcc unwind init when prof is enabled. This helps workaround
some bootstrapping issues.
2019-02-21 16:04:47 -08:00
Jason Evans
dca7060d5e
Avoid redefining tsd_t.
...
This fixes a build failure when integrating with FreeBSD's libc. This
regression was introduced by d1e11d48d4
2019-02-20 20:27:55 -08:00
Qi Wang
9015deb126
Add build_doc by default.
...
However, skip building the docs (and output warnings) if XML support is missing.
This allows `make install` to succeed w/o `make dist`.
2019-02-08 14:13:20 -08:00
Qi Wang
23b15e764b
Add --disable-libdl to travis.
2019-02-06 21:00:59 -08:00
Qi Wang
2db2d2ef5e
Make background_thread not dependent on libdl.
...
When not using libdl, still allows background_thread to be enabled.
2019-02-06 21:00:59 -08:00
Qi Wang
1f55a15467
Add configure option --disable-libdl.
...
This makes it possible to build full static binary.
2019-02-06 21:00:59 -08:00
Qi Wang
8e9a613122
Disable muzzy decay by default.
2019-02-04 14:38:54 -08:00
Qi Wang
e13400c919
Sanity check szind on tcache flush.
...
This adds some overhead to the tcache flush path (which is one of the
popular paths). Guard it behind a config option.
2019-02-01 12:31:34 -08:00
Qi Wang
b33eb26dee
Tweak the spacing for the total_wait_time per second.
2019-01-28 15:37:19 -08:00
Qi Wang
374dc30d3d
Update copyright dates.
2019-01-25 13:25:20 -08:00
Qi Wang
e3db480f6f
Rename huge_threshold to oversize_threshold.
...
The keyword huge tend to remind people of huge pages which is not relevent to
the feature.
2019-01-25 13:15:45 -08:00
Qi Wang
350809dc5d
Set huge_threshold to 8M by default.
...
This feature uses an dedicated arena to handle huge requests, which
significantly improves VM fragmentation. In production workload we tested it
often reduces VM size by >30%.
2019-01-24 13:29:23 -08:00
Qi Wang
d3145014a0
Explicitly use arena 0 in alignment and OOM tests.
...
This helps us avoid issues with size based routing (i.e. the huge_threshold
feature).
2019-01-24 13:29:23 -08:00
Edward Tomasz Napierala
a7b0a124c3
Mention different mmap(2) behaviour with retain:true.
2019-01-23 18:34:59 -08:00
Qi Wang
522d1e7b4b
Tweak the spacing for nrequests in stats output.
2019-01-23 17:42:12 -08:00
Qi Wang
8c9571376e
Fix stats output (rate for total # of requests).
...
The rate calculation for the total row was missing.
2019-01-23 17:42:12 -08:00
Qi Wang
7a815c1b7c
Un-experimental the huge_threshold feature.
2019-01-16 12:28:57 -08:00
Qi Wang
bbe8e6a909
Avoid creating bg thds for huge arena lone.
...
For low arena count settings, the huge threshold feature may trigger an unwanted
bg thd creation. Given that the huge arena does eager purging by default,
bypass bg thd creation when initializing the huge arena.
2019-01-15 16:00:34 -08:00
Jason Evans
b6f1f2669a
Revert "Customize cloning to include tags so that VERSION is valid."
...
This reverts commit 646af596d8
2019-01-14 10:35:48 -08:00
Jason Evans
225d89998b
Revert "Remove --branch=${CIRRUS_BASE_BRANCH} in git clone command."
...
This reverts commit fc13a7f1fa
2019-01-14 10:35:48 -08:00
Qi Wang
f459454afe
Avoid potential issues on extent zero-out.
...
When custom extent_hooks or transparent huge pages are in use, the purging
semantics may change, which means we may not get zeroed pages on repopulating.
Fixing the issue by manually memset for such cases.
2019-01-11 19:16:12 -08:00
Qi Wang
0ecd5addb1
Force purge on thread death only when w/o bg thds.
2019-01-11 19:15:34 -08:00
Jason Evans
fc13a7f1fa
Remove --branch=${CIRRUS_BASE_BRANCH} in git clone command.
...
The --branch parameter is unnecessary, and may avoid problems when
testing directly on the dev branch.
2019-01-11 13:50:56 -08:00
Jason Evans
646af596d8
Customize cloning to include tags so that VERSION is valid.
2019-01-10 15:14:33 -08:00
Li-Wen Hsu
6910fcb208
Add Cirrus-CI config for FreeBSD builds
2019-01-10 15:14:33 -08:00
Faidon Liambotis
471191075d
Replace -lpthread with -pthread
...
This automatically adds -latomic if and when needed, e.g. on riscv64
systems.
Fixes #1401 .
2019-01-09 13:43:33 -08:00
Leonardo Santagada
daa0e436ba
implement malloc_getcpu for windows
2019-01-08 14:34:45 -08:00
John Ericson
4e920d2c9d
Add --{enable,disable}-{static,shared} to configure script
...
My distro offers a custom toolchain where it's not possible to make
static libs, so it's insufficient to just delete the libs I don't want.
I actually need to avoid building them in the first place.
2018-12-19 13:34:26 -08:00
Qi Wang
7241bf5b74
Only read arena index from extent on the tcache flush path.
...
Add exten_arena_ind_get() to avoid loading the actual arena ptr in case we just
need to check arena matching.
2018-12-18 15:19:30 -08:00
Qi Wang
441335d924
Add unit test for producer-consumer pattern.
2018-12-18 15:09:53 -08:00
