From patchwork Wed Jul 8 10:58:40 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Szabolcs Nagy X-Patchwork-Id: 1325158 Return-Path: X-Original-To: incoming@patchwork.ozlabs.org Delivered-To: patchwork-incoming@bilbo.ozlabs.org Authentication-Results: ozlabs.org; spf=pass (sender SPF authorized) smtp.mailfrom=sourceware.org (client-ip=2620:52:3:1:0:246e:9693:128c; helo=sourceware.org; envelope-from=libc-alpha-bounces@sourceware.org; receiver=) Authentication-Results: ozlabs.org; dmarc=none (p=none dis=none) header.from=arm.com Authentication-Results: ozlabs.org; dkim=pass (1024-bit key; unprotected) header.d=armh.onmicrosoft.com header.i=@armh.onmicrosoft.com header.a=rsa-sha256 header.s=selector2-armh-onmicrosoft-com header.b=vfvpdQlW; dkim=pass (1024-bit key) header.d=armh.onmicrosoft.com header.i=@armh.onmicrosoft.com header.a=rsa-sha256 header.s=selector2-armh-onmicrosoft-com header.b=vfvpdQlW; dkim-atps=neutral Received: from sourceware.org (server2.sourceware.org [IPv6:2620:52:3:1:0:246e:9693:128c]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by ozlabs.org (Postfix) with ESMTPS id 4B1xBZ29sSz9sRK for ; Wed, 8 Jul 2020 20:59:02 +1000 (AEST) Received: from server2.sourceware.org (localhost [IPv6:::1]) by sourceware.org (Postfix) with ESMTP id 274C23861028; Wed, 8 Jul 2020 10:59:00 +0000 (GMT) X-Original-To: libc-alpha@sourceware.org Delivered-To: libc-alpha@sourceware.org Received: from EUR01-HE1-obe.outbound.protection.outlook.com (mail-eopbgr130072.outbound.protection.outlook.com [40.107.13.72]) by sourceware.org (Postfix) with ESMTPS id 3AE8F3861028 for ; Wed, 8 Jul 2020 10:58:55 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.3.2 sourceware.org 3AE8F3861028 Authentication-Results: sourceware.org; dmarc=none (p=none dis=none) header.from=arm.com Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=Szabolcs.Nagy@arm.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=armh.onmicrosoft.com; s=selector2-armh-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=SJzkRJIAPM2JFDeGLtidKsWvGLgEXocjRyCBGQ6UHkc=; b=vfvpdQlW/lqFWzSBjzzSXkwgKT+PZJoRTUuyi7AGry0mI2SZkdcNWSsMFFjRyIuyhrpw4V5n7MEbvyZIlbmH+2vLQivN4m43w7MCx1v+SYoOednkiTc9VM4bd7LI9ot3wfqf4ft7VM1KCzS8UQXaepi2wrzLZtnuOnoS/7J7o/Y= Received: from AM5PR04CA0036.eurprd04.prod.outlook.com (2603:10a6:206:1::49) by AM0PR08MB5506.eurprd08.prod.outlook.com (2603:10a6:208:17e::12) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3153.22; Wed, 8 Jul 2020 10:58:53 +0000 Received: from VE1EUR03FT019.eop-EUR03.prod.protection.outlook.com (2603:10a6:206:1:cafe::4) by AM5PR04CA0036.outlook.office365.com (2603:10a6:206:1::49) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3174.20 via Frontend Transport; Wed, 8 Jul 2020 10:58:53 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 63.35.35.123) smtp.mailfrom=arm.com; sourceware.org; dkim=pass (signature was verified) header.d=armh.onmicrosoft.com; sourceware.org; dmarc=bestguesspass action=none header.from=arm.com; Received-SPF: Pass (protection.outlook.com: domain of arm.com designates 63.35.35.123 as permitted sender) receiver=protection.outlook.com; client-ip=63.35.35.123; helo=64aa7808-outbound-1.mta.getcheckrecipient.com; Received: from 64aa7808-outbound-1.mta.getcheckrecipient.com (63.35.35.123) by VE1EUR03FT019.mail.protection.outlook.com (10.152.18.153) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3174.21 via Frontend Transport; Wed, 8 Jul 2020 10:58:52 +0000 Received: ("Tessian outbound b8ad5ab47c8c:v62"); Wed, 08 Jul 2020 10:58:52 +0000 X-CheckRecipientChecked: true X-CR-MTA-CID: 0c2caeac64896cb7 X-CR-MTA-TID: 64aa7808 Received: from fc7d95ac5e09.1 by 64aa7808-outbound-1.mta.getcheckrecipient.com id 259283DF-D6C8-4525-8FBD-0DF8D5374E6A.1; Wed, 08 Jul 2020 10:58:47 +0000 Received: from EUR03-DB5-obe.outbound.protection.outlook.com by 64aa7808-outbound-1.mta.getcheckrecipient.com with ESMTPS id fc7d95ac5e09.1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384); Wed, 08 Jul 2020 10:58:47 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=EyMzp47icMhTSCH7UrD5wlnvhq10v8tp1lsFYBRZxqK6Cvk/Y/KU5SDY1Ppx3h6a5iYavxqCzrrWxhCwZcnO+6J9gKJT+ph/53xCcqdROjx5ew8rIazz1EWhRR39mvwxSU1PU5xreeniTug8UlE2y+VVggRvY91JnKqYQBSkrH/Th0D+fFT2iHihwB3sbxPHrI2ckQnXOTMXnwg8sYUsayOcQ0WyIGN9McBhTPB70sQlt2cFvbJTuKBOXl+CS1b+6Eh5YWbpPrYD1yWlgZMV41vJaLxTqmB58fZ/t2oKlD9i+2YqqASm064ldy5VcIphIL6HEXKp1ThL9K6NTQnjaQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=SJzkRJIAPM2JFDeGLtidKsWvGLgEXocjRyCBGQ6UHkc=; b=JfzjKsOAMDIdvh6Yd1hnEVzuRkQa0LURcoBrIVyEy85ajQicm2D5Wm2ViE52TEEeSt1SbYapT0c/OmMF7SIBIkZ63HyYNkxw0UNpk603NO2qCWJxnBCuBmGGD/BEePLDtKymPZhz7+4kVkPeAZcVL2c01bDBpKxQsE2GM3u6in+hd7RAZgDJC9dHQfP/fpFOU/qww15RJSC5IPJyjzYye64BtAFCXo7PdLVhS7qT9QioviEWb+A13HvDoUAe//xmiUp1eS8YvVnpxYjRWuumJZBrpinUMDGue9zFxyRUAQZbf/1QZLvzj4+VNMwDsU0WOGZlbpGRorq/PqR/5Ml2zg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=arm.com; dmarc=pass action=none header.from=arm.com; dkim=pass header.d=arm.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=armh.onmicrosoft.com; s=selector2-armh-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=SJzkRJIAPM2JFDeGLtidKsWvGLgEXocjRyCBGQ6UHkc=; b=vfvpdQlW/lqFWzSBjzzSXkwgKT+PZJoRTUuyi7AGry0mI2SZkdcNWSsMFFjRyIuyhrpw4V5n7MEbvyZIlbmH+2vLQivN4m43w7MCx1v+SYoOednkiTc9VM4bd7LI9ot3wfqf4ft7VM1KCzS8UQXaepi2wrzLZtnuOnoS/7J7o/Y= Authentication-Results-Original: sourceware.org; dkim=none (message not signed) header.d=none;sourceware.org; dmarc=none action=none header.from=arm.com; Received: from AM6PR08MB3047.eurprd08.prod.outlook.com (2603:10a6:209:4c::23) by AM6PR08MB4133.eurprd08.prod.outlook.com (2603:10a6:20b:ab::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3153.27; Wed, 8 Jul 2020 10:58:46 +0000 Received: from AM6PR08MB3047.eurprd08.prod.outlook.com ([fe80::2404:de9f:78c0:313c]) by AM6PR08MB3047.eurprd08.prod.outlook.com ([fe80::2404:de9f:78c0:313c%6]) with mapi id 15.20.3153.031; Wed, 8 Jul 2020 10:58:46 +0000 From: Szabolcs Nagy To: libc-alpha@sourceware.org Subject: [PATCH v6 1/3] rtld: Add rtld.nns tunable for the number of supported namespaces Date: Wed, 8 Jul 2020 11:58:40 +0100 Message-Id: <7f6134b23fbbf616334965c61dc85a176cb33597.1594205502.git.szabolcs.nagy@arm.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: References: X-ClientProxiedBy: LNXP265CA0072.GBRP265.PROD.OUTLOOK.COM (2603:10a6:600:5d::36) To AM6PR08MB3047.eurprd08.prod.outlook.com (2603:10a6:209:4c::23) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from localhost.localdomain (217.140.106.53) by LNXP265CA0072.GBRP265.PROD.OUTLOOK.COM (2603:10a6:600:5d::36) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3153.22 via Frontend Transport; Wed, 8 Jul 2020 10:58:45 +0000 X-Mailer: git-send-email 2.17.1 X-Originating-IP: [217.140.106.53] X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-HT: Tenant X-MS-Office365-Filtering-Correlation-Id: 0eb31d4e-04cd-425d-d113-08d8232de6fa X-MS-TrafficTypeDiagnostic: AM6PR08MB4133:|AM0PR08MB5506: X-Microsoft-Antispam-PRVS: x-checkrecipientrouted: true NoDisclaimer: true X-MS-Oob-TLC-OOBClassifiers: OLM:9508;OLM:9508; X-Forefront-PRVS: 04583CED1A X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam-Untrusted: BCL:0; X-Microsoft-Antispam-Message-Info-Original: A90GSdhRPGPnQ70UvA3ntZ4uNTCdWxh+KgPWmnHnf5Zv0OvbYNnA7TiSAFqL3O1XtxZwAnM2KvoB6fpGBy1/bGJ6YISpkkswRhRbP3/rVJWnKQKZi7JnNBK5Rbvlqz6DLxMTehDgBK6upsAA07H7+39ya+PsmbRBnIE7F6GvJ8rAHFIZFtA83h/XyL053xhn/ecDY7D+9IoCkz46q6o2XIh2bCX24hOB7YxveTXHdE7VXRi4sagvwj8UKVpjbL8nfp3DToxAIDvTHbxkFBVuIQDIBqwz3H2wfNJjL5rKr5/fbkhx0333TE6dQ5tYDAsikd0ze1mdNW15+eEsvCMtqSyd64utxZy8Kz09N6RwOWdBCav9uyacWcw4eUmUbC0aq48Es2dApiuvMnEHtu0VH4CdcOgeOD8+hWEO1H1d9LlgzjzDSUoDAPzz72EkQPFfIsFUMuFoZMuyiw86SVPA1g== X-Forefront-Antispam-Report-Untrusted: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:AM6PR08MB3047.eurprd08.prod.outlook.com; PTR:; CAT:NONE; SFTY:; SFS:(4636009)(39860400002)(346002)(366004)(136003)(396003)(376002)(36756003)(316002)(6506007)(52116002)(6916009)(86362001)(6512007)(66946007)(66476007)(66556008)(6666004)(83380400001)(6486002)(44832011)(956004)(2616005)(2906002)(69590400007)(26005)(5660300002)(30864003)(16526019)(186003)(8936002)(8676002)(478600001)(966005)(136400200001); DIR:OUT; SFP:1101; X-MS-Exchange-AntiSpam-MessageData: 6Y7YTCHoDGShohDH30Sgr77AGts+hJLZnTRpUARPmC5pRdP0aWG2kGf2mCUhpKwxh4I2Odwk3CmALYcpsFJYFxj/rqaHyGjdJIGRFhUzuknRjc/WS8zIsfVzRh8iMFvsU3etqPV7iwaRA2OcpNHudRyhjAb86qyqgH5HqTmqWtYA6aFdnc2AjO0MhArcjUfNMFWy3AFerM/t+nu2rPOoOHdgTxqu6opWw6CUZjEbyVndMO5E6vSKh7w50fTCfKZ7Ju42udNTPJc2AtIvtgMB/XB4plLZjCR1ForGPW4Q7bmYCt4r5Q+e9Jxe/mblDsGLHoeKtOBzIp9bKLEvM2Gs2lhqBJ4X+UOMLdzJqua6Yvcp5yati+rcP9VQMRcR9reH8duH7Q2Ex3a3lLfqGmojHXOBlE005+3jEKuJrvJRWl2qm6ZywXfzT5PWqbklWm1u5FLj65qjbRVsELiwI49tqfmgPHUcvmhDl1wXEb1IdAgI6EsqaidFpiEezj0GTiDt X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM6PR08MB4133 Original-Authentication-Results: sourceware.org; dkim=none (message not signed) header.d=none; sourceware.org; dmarc=none action=none header.from=arm.com; X-EOPAttributedMessage: 0 X-MS-Exchange-Transport-CrossTenantHeadersStripped: VE1EUR03FT019.eop-EUR03.prod.protection.outlook.com X-Forefront-Antispam-Report: CIP:63.35.35.123; CTRY:IE; LANG:en; SCL:1; SRV:; IPV:CAL; SFV:NSPM; H:64aa7808-outbound-1.mta.getcheckrecipient.com; PTR:ec2-63-35-35-123.eu-west-1.compute.amazonaws.com; CAT:NONE; SFTY:; SFS:(4636009)(346002)(136003)(396003)(376002)(39860400002)(46966005)(86362001)(16526019)(6666004)(6506007)(26005)(186003)(8676002)(2906002)(70586007)(70206006)(6916009)(966005)(2616005)(956004)(336012)(36906005)(44832011)(6486002)(478600001)(8936002)(69590400007)(316002)(5660300002)(47076004)(82310400002)(81166007)(82740400003)(6512007)(30864003)(36756003)(83380400001)(356005)(136400200001); DIR:OUT; SFP:1101; X-MS-Office365-Filtering-Correlation-Id-Prvs: 1c96364b-4e4c-4dae-8690-08d8232de2d6 X-Forefront-PRVS: 04583CED1A X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 4rzM9exj773UQIaDO4cbUFI0QHbb7ptYq47Q/4j7qHmW33d3VHwo5rYdfm+s3IuSuxYw6+Pvnmkq1F5UP1wBvmE9azYnct+61iCDGGTdCz3tK9iwrxJxN30RHQeDDfIC28t0VXXB5Q2DxN1JrLUg+UEa8gXNK23i6lZGg6Ion9mGnNaR8vxNN0gK1ExzYwSgWgUNU92mD4e9xMC9NV2YshKgi8/DAx/hxQ1U1CBnQRJsTEDQ5FPd01QqdHINmj4mECvbwLMaqbEwykjsb/edtD+C2GvDrslEkSIoqyYq88ZwTI4lPwGi8rfM9EmJA7us91+nhTiKujoJuakUfi+ut9Vml4duuEubwkurlxlTizl+dPf4bPd77jgNbjUwHcqoLkqS96Q0DwhANwluDRal1ySGt58pa3Pu6eJ7fQ4TcsKK44oINhFiU1NURxmehs45GK3dETaNomRyH5YwxcKyxSNKsH3DO8nnwi4aIngwmagtXtLNJYRom7kXaHuqW7iX X-OriginatorOrg: arm.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 08 Jul 2020 10:58:52.7073 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 0eb31d4e-04cd-425d-d113-08d8232de6fa X-MS-Exchange-CrossTenant-Id: f34e5979-57d9-4aaa-ad4d-b122a662184d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=f34e5979-57d9-4aaa-ad4d-b122a662184d; Ip=[63.35.35.123]; Helo=[64aa7808-outbound-1.mta.getcheckrecipient.com] X-MS-Exchange-CrossTenant-AuthSource: VE1EUR03FT019.eop-EUR03.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR08MB5506 X-Spam-Status: No, score=-16.1 required=5.0 tests=BAYES_00, DKIM_SIGNED, DKIM_VALID, GIT_PATCH_0, MSGID_FROM_MTA_HEADER, RCVD_IN_DNSWL_LOW, RCVD_IN_MSPIKE_H2, SPF_HELO_PASS, SPF_PASS, TXREP, UNPARSEABLE_RELAY autolearn=ham autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on server2.sourceware.org X-BeenThere: libc-alpha@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Libc-alpha mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: libc-alpha-bounces@sourceware.org Sender: "Libc-alpha" TLS_STATIC_SURPLUS is 1664 bytes currently which is not enough to support DL_NNS (== 16) number of dynamic link namespaces, if we assume 192 bytes of TLS are reserved for libc use and 144 bytes are reserved for other system libraries that use IE TLS. A new tunable is introduced to control the number of supported namespaces and to adjust the surplus static TLS size as follows: surplus_tls = 192 * (rtld.nns-1) + 144 * rtld.nns + 512 The default is rtld.nns == 4 and then the surplus TLS size is the same as before, so the behaviour is unchanged by default. If an application creates more namespaces than the rtld.nns setting allows, then it is not guaranteed to work, but the limit is not checked. So existing usage will continue to work, but in the future if an application creates more than 4 dynamic link namespaces then the tunable will need to be set. In this patch DL_NNS is a fixed value and provides a maximum to the rtld.nns setting. Static linking used fixed 2048 bytes surplus TLS, this is changed so the same contract is used as for dynamic linking. With static linking DL_NNS == 1 so rtld.nns tunable is forced to 1, so by default the surplus TLS is reduced to 144 + 512 = 656 bytes. This change is not expected to cause problems. Tested on aarch64-linux-gnu and x86_64-linux-gnu. Reviewed-by: Carlos O'Donell --- v6: - rebase on the rseq changes: now more tls is needed for many auditors to work, but this is fixed in a followup patch. - add reviewed-by. v5: - Split the patch into two: rtld.nns and tls optimization parts. - Use rtld.nns instead of dl.nns. - Renamed the init function and moved the calls close to the first use of surplus tls size. - Updated the tunable documentation. v4: - Rebased and moved this log out of the commit message. - Minor commit message wording changes. v3: - archived at https://sourceware.org/pipermail/libc-alpha/2020-March/111660.html - Replace TLS_STATIC_SURPLUS with GLRO(dl_tls_static_surplus) and simplify related logic. - In case of static linking, replace GL(dl_tls_static_size) with GLRO(dl_tls_static_surplus) in the code paths before the GL(dl_tls_static_size) value is actually computed. - Update comments and the test code. - Document the new tunables. - Update description, mention static linking. v2: - Add dl.nns tunable. - Add dl.optional_static_tls tunable. - New surplus TLS usage contract that works reliably up to dl.nns namespaces. --- csu/libc-tls.c | 28 +++++++++---------- elf/dl-tls.c | 55 ++++++++++++++++++++++++++++++++++---- elf/dl-tunables.list | 9 +++++++ elf/rtld.c | 3 +++ manual/tunables.texi | 21 +++++++++++++++ sysdeps/generic/ldsodefs.h | 8 ++++++ 6 files changed, 105 insertions(+), 19 deletions(-) diff --git a/csu/libc-tls.c b/csu/libc-tls.c index 73ade0fec5..e2603157e8 100644 --- a/csu/libc-tls.c +++ b/csu/libc-tls.c @@ -46,13 +46,16 @@ bool _dl_tls_dtv_gaps; struct dtv_slotinfo_list *_dl_tls_dtv_slotinfo_list; /* Number of modules in the static TLS block. */ size_t _dl_tls_static_nelem; -/* Size of the static TLS block. Giving this initialized value - preallocates some surplus bytes in the static TLS area. */ -size_t _dl_tls_static_size = 2048; +/* Size of the static TLS block. */ +size_t _dl_tls_static_size; /* Size actually allocated in the static TLS block. */ size_t _dl_tls_static_used; /* Alignment requirement of the static TLS block. */ size_t _dl_tls_static_align; +/* Size of surplus space in the static TLS area for dynamically + loaded modules with IE-model TLS or for TLSDESC optimization. + See comments in elf/dl-tls.c where it is initialized. */ +size_t _dl_tls_static_surplus; /* Generation counter for the dtv. */ size_t _dl_tls_generation; @@ -81,10 +84,8 @@ init_slotinfo (void) static void init_static_tls (size_t memsz, size_t align) { - /* That is the size of the TLS memory for this object. The initialized - value of _dl_tls_static_size is provided by dl-open.c to request some - surplus that permits dynamic loading of modules with IE-model TLS. */ - GL(dl_tls_static_size) = roundup (memsz + GL(dl_tls_static_size), + /* That is the size of the TLS memory for this object. */ + GL(dl_tls_static_size) = roundup (memsz + GLRO(dl_tls_static_surplus), TLS_TCB_ALIGN); #if TLS_TCB_AT_TP GL(dl_tls_static_size) += TLS_TCB_SIZE; @@ -125,25 +126,24 @@ __libc_setup_tls (void) break; } + /* Calculate the size of the static TLS surplus. */ + _dl_tls_static_surplus_init (); + /* We have to set up the TCB block which also (possibly) contains 'errno'. Therefore we avoid 'malloc' which might touch 'errno'. Instead we use 'sbrk' which would only uses 'errno' if it fails. In this case we are right away out of memory and the user gets - what she/he deserves. - - The initialized value of _dl_tls_static_size is provided by dl-open.c - to request some surplus that permits dynamic loading of modules with - IE-model TLS. */ + what she/he deserves. */ #if TLS_TCB_AT_TP /* Align the TCB offset to the maximum alignment, as _dl_allocate_tls_storage (in elf/dl-tls.c) does using __libc_memalign and dl_tls_static_align. */ - tcb_offset = roundup (memsz + GL(dl_tls_static_size), max_align); + tcb_offset = roundup (memsz + GLRO(dl_tls_static_surplus), max_align); tlsblock = __sbrk (tcb_offset + TLS_INIT_TCB_SIZE + max_align); #elif TLS_DTV_AT_TP tcb_offset = roundup (TLS_INIT_TCB_SIZE, align ?: 1); tlsblock = __sbrk (tcb_offset + memsz + max_align - + TLS_PRE_TCB_SIZE + GL(dl_tls_static_size)); + + TLS_PRE_TCB_SIZE + GLRO(dl_tls_static_surplus)); tlsblock += TLS_PRE_TCB_SIZE; #else /* In case a model with a different layout for the TCB and DTV diff --git a/elf/dl-tls.c b/elf/dl-tls.c index ca13778ca9..924ee5d989 100644 --- a/elf/dl-tls.c +++ b/elf/dl-tls.c @@ -29,10 +29,54 @@ #include #include -/* Amount of excess space to allocate in the static TLS area - to allow dynamic loading of modules defining IE-model TLS data. */ -#define TLS_STATIC_SURPLUS 64 + DL_NNS * 176 +#define TUNABLE_NAMESPACE rtld +#include + +/* Surplus static TLS, GLRO(dl_tls_static_surplus), is used for + + - IE TLS in libc.so for all dlmopen namespaces except in the initial + one where libc.so is not loaded dynamically but at startup time, + - IE TLS in other libraries which may be dynamically loaded even in the + initial namespace, + - and optionally for optimizing dynamic TLS access. + + The maximum number of namespaces is DL_NNS, but to support that many + namespaces correctly the static TLS allocation should be significantly + increased, which may cause problems with small thread stacks due to the + way static TLS is accounted (bug 11787). + + So there is a rtld.nns tunable limit on the number of supported namespaces + that affects the size of the static TLS and by default it's small enough + not to cause problems with existing applications. The limit is not + enforced or checked: it is the user's responsibility to increase rtld.nns + if more dlmopen namespaces are used. */ + +/* Size of initial-exec TLS in libc.so. */ +#define LIBC_IE_TLS 192 +/* Size of initial-exec TLS in libraries other than libc.so. + This should be large enough to cover runtime libraries of the + compiler such as libgomp and libraries in libc other than libc.so. */ +#define OTHER_IE_TLS 144 +/* Size of additional surplus TLS, placeholder for TLS optimizations. */ +#define OPT_SURPLUS_TLS 512 +void +_dl_tls_static_surplus_init (void) +{ + size_t nns; + +#if HAVE_TUNABLES + nns = TUNABLE_GET (nns, size_t, NULL); +#else + /* Default values of the tunables. */ + nns = 4; +#endif + if (nns > DL_NNS) + nns = DL_NNS; + GLRO(dl_tls_static_surplus) = ((nns - 1) * LIBC_IE_TLS + + nns * OTHER_IE_TLS + + OPT_SURPLUS_TLS); +} /* Out-of-memory handler. */ static void @@ -224,7 +268,8 @@ _dl_determine_tlsoffset (void) } GL(dl_tls_static_used) = offset; - GL(dl_tls_static_size) = (roundup (offset + TLS_STATIC_SURPLUS, max_align) + GL(dl_tls_static_size) = (roundup (offset + GLRO(dl_tls_static_surplus), + max_align) + TLS_TCB_SIZE); #elif TLS_DTV_AT_TP /* The TLS blocks start right after the TCB. */ @@ -268,7 +313,7 @@ _dl_determine_tlsoffset (void) } GL(dl_tls_static_used) = offset; - GL(dl_tls_static_size) = roundup (offset + TLS_STATIC_SURPLUS, + GL(dl_tls_static_size) = roundup (offset + GLRO(dl_tls_static_surplus), TLS_TCB_ALIGN); #else # error "Either TLS_TCB_AT_TP or TLS_DTV_AT_TP must be defined" diff --git a/elf/dl-tunables.list b/elf/dl-tunables.list index 0d398dd251..b07742d7b3 100644 --- a/elf/dl-tunables.list +++ b/elf/dl-tunables.list @@ -126,4 +126,13 @@ glibc { default: 3 } } + + rtld { + nns { + type: SIZE_T + minval: 1 + maxval: 16 + default: 4 + } + } } diff --git a/elf/rtld.c b/elf/rtld.c index 882b070cc0..99a8c75477 100644 --- a/elf/rtld.c +++ b/elf/rtld.c @@ -780,6 +780,9 @@ init_tls (void) } assert (i == GL(dl_tls_max_dtv_idx)); + /* Calculate the size of the static TLS surplus. */ + _dl_tls_static_surplus_init (); + /* Compute the TLS offsets for the various blocks. */ _dl_determine_tlsoffset (); diff --git a/manual/tunables.texi b/manual/tunables.texi index 4e68c7ff91..d18e141db7 100644 --- a/manual/tunables.texi +++ b/manual/tunables.texi @@ -31,6 +31,7 @@ their own namespace. @menu * Tunable names:: The structure of a tunable name * Memory Allocation Tunables:: Tunables in the memory allocation subsystem +* Dynamic Linking Tunables:: Tunables in the dynamic linking subsystem * Elision Tunables:: Tunables in elision subsystem * POSIX Thread Tunables:: Tunables in the POSIX thread subsystem * Hardware Capability Tunables:: Tunables that modify the hardware @@ -226,6 +227,26 @@ pointer, so add 4 on 32-bit systems or 8 on 64-bit systems to the size passed to @code{malloc} for the largest bin size to enable. @end deftp +@node Dynamic Linking Tunables +@section Dynamic Linking Tunables +@cindex dynamic linking tunables +@cindex rtld tunables + +@deftp {Tunable namespace} glibc.rtld +Dynamic linker behavior can be modified by setting the +following tunables in the @code{rtld} namespace: +@end deftp + +@deftp Tunable glibc.rtld.nns +Sets the number of supported dynamic link namespaces (see @code{dlmopen}). +Currently this limit can be set between 1 and 16 inclusive, the default is 4. +Each link namespace consumes some memory in all thread, and thus raising the +limit will increase the amount of memory each thread uses. Raising the limit +is useful when your application uses more than 4 dynamic linker audit modules +e.g. LD_AUDIT, or will use more than 4 dynamic link namespaces as created +by @code{dlmopen} with an lmid argument of @code{LM_ID_NEWLM}. +@end deftp + @node Elision Tunables @section Elision Tunables @cindex elision tunables diff --git a/sysdeps/generic/ldsodefs.h b/sysdeps/generic/ldsodefs.h index d08b97a5ef..5156410834 100644 --- a/sysdeps/generic/ldsodefs.h +++ b/sysdeps/generic/ldsodefs.h @@ -583,6 +583,11 @@ struct rtld_global_ro binaries, don't honor for PIEs). */ EXTERN ElfW(Addr) _dl_use_load_bias; + /* Size of surplus space in the static TLS area for dynamically + loaded modules with IE-model TLS or for TLSDESC optimization. + See comments in elf/dl-tls.c where it is initialized. */ + EXTERN size_t _dl_tls_static_surplus; + /* Name of the shared object to be profiled (if any). */ EXTERN const char *_dl_profile; /* Filename of the output file. */ @@ -1097,6 +1102,9 @@ extern size_t _dl_count_modids (void) attribute_hidden; /* Calculate offset of the TLS blocks in the static TLS block. */ extern void _dl_determine_tlsoffset (void) attribute_hidden; +/* Calculate the size of the static TLS surplus. */ +void _dl_tls_static_surplus_init (void) attribute_hidden; + #ifndef SHARED /* Set up the TCB for statically linked applications. This is called early during startup because we always use TLS (for errno and the