From patchwork Tue Jan 9 20:06:15 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "H.J. Lu" X-Patchwork-Id: 1884628 Return-Path: X-Original-To: incoming@patchwork.ozlabs.org Delivered-To: patchwork-incoming@legolas.ozlabs.org Authentication-Results: legolas.ozlabs.org; dkim=pass (2048-bit key; unprotected) header.d=gmail.com header.i=@gmail.com header.a=rsa-sha256 header.s=20230601 header.b=h451MnKL; dkim-atps=neutral Authentication-Results: legolas.ozlabs.org; spf=pass (sender SPF authorized) smtp.mailfrom=sourceware.org (client-ip=2620:52:3:1:0:246e:9693:128c; helo=server2.sourceware.org; envelope-from=libc-alpha-bounces+incoming=patchwork.ozlabs.org@sourceware.org; receiver=patchwork.ozlabs.org) Received: from server2.sourceware.org (server2.sourceware.org [IPv6:2620:52:3:1:0:246e:9693:128c]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (secp384r1) server-digest SHA384) (No client certificate requested) by legolas.ozlabs.org (Postfix) with ESMTPS id 4T8hln1cl8z1yPp for ; Wed, 10 Jan 2024 07:06:45 +1100 (AEDT) Received: from server2.sourceware.org (localhost [IPv6:::1]) by sourceware.org (Postfix) with ESMTP id 1AA8F3857BB7 for ; Tue, 9 Jan 2024 20:06:43 +0000 (GMT) X-Original-To: libc-alpha@sourceware.org Delivered-To: libc-alpha@sourceware.org Received: from mail-pj1-x1036.google.com (mail-pj1-x1036.google.com [IPv6:2607:f8b0:4864:20::1036]) by sourceware.org (Postfix) with ESMTPS id 4B4EC3858409 for ; Tue, 9 Jan 2024 20:06:21 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org 4B4EC3858409 Authentication-Results: sourceware.org; dmarc=pass (p=none dis=none) header.from=gmail.com Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=gmail.com ARC-Filter: OpenARC Filter v1.0.0 sourceware.org 4B4EC3858409 Authentication-Results: server2.sourceware.org; arc=none smtp.remote-ip=2607:f8b0:4864:20::1036 ARC-Seal: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1704830782; cv=none; b=BYSohjBLxo9Ou0sOGrkfUSYP89TrSx4/KCwN1qrEJNz3zJY5a/hBqzni+yAQKSMO68/1xPFyjT/wizfMiTnj5QBc47nxsjapCvVezEQJv6BEYl6CbFyczF7CvCXmkRDgaeu2nKP3gOctiWSQ3n1TA4wwEZaYXA+7xWpO0jBsAa4= ARC-Message-Signature: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1704830782; c=relaxed/simple; bh=M9AvoD8Aqs6257um81l3Wnm99dyi3J6XhZkaIH/yAc0=; h=DKIM-Signature:From:To:Subject:Date:Message-ID:MIME-Version; b=aQbijOLDRK3IpFGv8VqdPLOkG978XH1uadsWYOK8C0MahAnAY9lnhN7AOSySXinwJl11z22O6680k/LgpBKdu8DRfLXyTYxjMCKT/tPgZ9dACZ+ZN9GiGPOtwBFuDiWI6E0VcN3GKG/YYWclk2pV9Gl26Wd66VAsovYF4/LFpPQ= ARC-Authentication-Results: i=1; server2.sourceware.org Received: by mail-pj1-x1036.google.com with SMTP id 98e67ed59e1d1-28c0d8dd88bso2278790a91.2 for ; Tue, 09 Jan 2024 12:06:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1704830780; x=1705435580; darn=sourceware.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=8gg70xkDf+aW3HAwhgnAilQuj6AoF9ss0zHBQECPtw0=; b=h451MnKL8jgdJSaWApvUeTotfvede2UbqrvQtvQlbZ2n4dbbTTgGaEx/z6tbCi8MKl F/TdSFVf0CrOQ8Mt1JYUBERwKSWFM917ZLdiQYtAvj30ReC9SXYLhB6Gbu8WyF//aQwW 0764GOXKYgYhmeVlNWE3Z0wNK8WvYKMWT83yMCz1LrcAAZVo5l42JHV16lupSqck7/AS Pk1bVRH71qaiYqV3+tdAvXDiy9LN/IQCb3H20r39SBgktIdyM9thnyZ2QhI7h7dUTtX6 4KaF91vF6dYAt16KtcBAlemGz4ODZU1HYr5ElDbFD9j1jkhyvGEHgZpUwtSOIHIpiena HXLA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1704830780; x=1705435580; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=8gg70xkDf+aW3HAwhgnAilQuj6AoF9ss0zHBQECPtw0=; b=X+FNz0C4tbPoWu4gbLVt7eNFdSPTWv/b/rSYtSfhAIv+N4o5O3a9qtcUi0k8s8ymA2 22TWeyCD/Pt7vnl1za4XUArUPwjXePJgLyzPcdVbNhN6PmwPVHo/o2GZ0zSrmvmz6P4X dCPmML2T+gsWGQmFtTaWTVA5oPXQooFc96gyOGnGZ9vNPwa2pSOaGjK9ZwIlfd1mbp0Z CUD9/WZEK0Rtedo960iVXaYCO7JaENUowg5ia44egZqGkXQio5vEujHt5IPqvlMqoRZ5 C8tu1FDIgFgVGxKzOYMBRIfM2f7GreEzXtRRLvEiSXtJ8uoq7ktfq9n7RGIpG2W51hEp mGXA== X-Gm-Message-State: AOJu0Yz6M7qd1SNafopmohyM4oLDbPR3wu0B7SOucrcFq/Y2X/3qnkRO UkEwhkrSGNUS3BrqpDLu8ds= X-Google-Smtp-Source: AGHT+IECgexCngURY7/ewd6O2usUJIhDXC712EkTwpj+LjEMY6iB+Tedan+JKgoZ3dhP2/QMSZyh2Q== X-Received: by 2002:a17:90b:8d5:b0:28d:4fad:21bb with SMTP id ds21-20020a17090b08d500b0028d4fad21bbmr2434638pjb.7.1704830780263; Tue, 09 Jan 2024 12:06:20 -0800 (PST) Received: from gnu-cfl-3.localdomain ([172.56.169.119]) by smtp.gmail.com with ESMTPSA id db4-20020a17090ad64400b00286da7407f2sm8994270pjb.7.2024.01.09.12.06.19 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 09 Jan 2024 12:06:19 -0800 (PST) Received: from gnu-cfl-3.. (localhost [IPv6:::1]) by gnu-cfl-3.localdomain (Postfix) with ESMTP id BF86D740676; Tue, 9 Jan 2024 12:06:18 -0800 (PST) From: "H.J. Lu" To: libc-alpha@sourceware.org Cc: adhemerval.zanella@linaro.org, goldstein.w.n@gmail.com Subject: [PATCH v2 1/4] x86: Move x86-64 shadow stack startup codes Date: Tue, 9 Jan 2024 12:06:15 -0800 Message-ID: <20240109200618.1508659-2-hjl.tools@gmail.com> X-Mailer: git-send-email 2.43.0 In-Reply-To: <20240109200618.1508659-1-hjl.tools@gmail.com> References: <20240109200618.1508659-1-hjl.tools@gmail.com> MIME-Version: 1.0 X-Spam-Status: No, score=-3024.3 required=5.0 tests=BAYES_00, DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, FREEMAIL_FROM, GIT_PATCH_0, RCVD_IN_DNSWL_NONE, SPF_HELO_NONE, SPF_PASS, TXREP, T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org X-BeenThere: libc-alpha@sourceware.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: Libc-alpha mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: libc-alpha-bounces+incoming=patchwork.ozlabs.org@sourceware.org Move sysdeps/x86/libc-start.h to sysdeps/x86_64/libc-start.h and use sysdeps/generic/libc-start.h for i386. --- sysdeps/{x86 => x86_64}/libc-start.h | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) rename sysdeps/{x86 => x86_64}/libc-start.h (98%) diff --git a/sysdeps/x86/libc-start.h b/sysdeps/x86_64/libc-start.h similarity index 98% rename from sysdeps/x86/libc-start.h rename to sysdeps/x86_64/libc-start.h index c3cc05888d..63fef17029 100644 --- a/sysdeps/x86/libc-start.h +++ b/sysdeps/x86_64/libc-start.h @@ -1,4 +1,4 @@ -/* X86 definitions for libc main startup. +/* x86-64 definitions for libc main startup. Copyright (C) 2018-2024 Free Software Foundation, Inc. This file is part of the GNU C Library. From patchwork Tue Jan 9 20:06:16 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "H.J. Lu" X-Patchwork-Id: 1884629 Return-Path: X-Original-To: incoming@patchwork.ozlabs.org Delivered-To: patchwork-incoming@legolas.ozlabs.org Authentication-Results: legolas.ozlabs.org; dkim=pass (2048-bit key; unprotected) header.d=gmail.com header.i=@gmail.com header.a=rsa-sha256 header.s=20230601 header.b=Mn0rHzxB; dkim-atps=neutral Authentication-Results: legolas.ozlabs.org; spf=pass (sender SPF authorized) smtp.mailfrom=sourceware.org (client-ip=2620:52:3:1:0:246e:9693:128c; helo=server2.sourceware.org; envelope-from=libc-alpha-bounces+incoming=patchwork.ozlabs.org@sourceware.org; receiver=patchwork.ozlabs.org) Received: from server2.sourceware.org (server2.sourceware.org [IPv6:2620:52:3:1:0:246e:9693:128c]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (secp384r1) server-digest SHA384) (No client certificate requested) by legolas.ozlabs.org (Postfix) with ESMTPS id 4T8hlt12lsz1yPm for ; Wed, 10 Jan 2024 07:06:50 +1100 (AEDT) Received: from server2.sourceware.org (localhost [IPv6:::1]) by sourceware.org (Postfix) with ESMTP id 2AC6E3857BB2 for ; Tue, 9 Jan 2024 20:06:48 +0000 (GMT) X-Original-To: libc-alpha@sourceware.org Delivered-To: libc-alpha@sourceware.org Received: from mail-pj1-x1030.google.com (mail-pj1-x1030.google.com [IPv6:2607:f8b0:4864:20::1030]) by sourceware.org (Postfix) with ESMTPS id 3F0983858C39 for ; Tue, 9 Jan 2024 20:06:21 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org 3F0983858C39 Authentication-Results: sourceware.org; dmarc=pass (p=none dis=none) header.from=gmail.com Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=gmail.com ARC-Filter: OpenARC Filter v1.0.0 sourceware.org 3F0983858C39 Authentication-Results: server2.sourceware.org; arc=none smtp.remote-ip=2607:f8b0:4864:20::1030 ARC-Seal: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1704830783; cv=none; b=HfZyc7GtPu0vqnnCGRpuF/8NwMZsn0VW+aGvm5E8aNMubA4GcNbFsltYpqjXJ/MtomnfYNOA6aMrE6J7/j3Ddcc/YlPnvH6lTD6xkTaDvGl0xLpoyFoprUUQCUQr5GG7YFwyyb76QA5qDOiNIt2AqASmeIG7f0ZJRF9EjdSodCk= ARC-Message-Signature: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1704830783; c=relaxed/simple; bh=eY9o3A/Ua6+L9R5xE4zQrNxqilQpakr/XNZkB5NJjco=; h=DKIM-Signature:From:To:Subject:Date:Message-ID:MIME-Version; b=Lv/tbxrjLj/Go5Z9Q83GLITLOZPRelQWyie6bRbbsH2W5LwVIudpd0k/auMWPAPcjMG6I9i70A+OUyK2KaZSbR0bMcOTw5c4MbI4JkpsMzYHiXPwQq22A5Q9G4R3quts+cwdDB/ZeGls+e6JDJCVIDzE1nidCs5wS121y0x5J1o= ARC-Authentication-Results: i=1; server2.sourceware.org Received: by mail-pj1-x1030.google.com with SMTP id 98e67ed59e1d1-28c2b8d6f2aso2230814a91.2 for ; Tue, 09 Jan 2024 12:06:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1704830780; x=1705435580; darn=sourceware.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=iisgiVoaUxCXz3Gl3SwC/cdsk1FlRAFZmjHqOeOFRpE=; b=Mn0rHzxBYmOq35XK5svSI9i6CEfkAe5DNvnSheGMJv3JC3g7Vb+4vfntHGnq085/D0 drnX0yPqha5iElC0/Ew0tZ0uRSO8BKfsz06RwWSIZXNHYMLfweW/a8NbxxChyFAA6qor v40g1kLbljpyOKsaJ4nKEUaP3vwdsjlyWe+kWWD5W/YpaFor8En8h4chMqPU3cnxodb7 MvuSRnKfvGLu8pwpCGFLwPeZBWmEIXJ9eNECIN0wwYqVI29g3TxPfvoj2La/Ej/Y18q+ KRkN0JOGVfD4R2vdLENtEOiioUZH4jze1Ua1v2z06zioOF1kng+1RUoZxN+dCUKkdnWJ KzWw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1704830780; x=1705435580; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=iisgiVoaUxCXz3Gl3SwC/cdsk1FlRAFZmjHqOeOFRpE=; b=hRQ7A7TsHyVxSwY3IN5KEVi0sV/XR3qjXJej8ojHk5s7u30U5YwLwOq2WNzot9ar5f Q/kT/zTKOWIAJhvZ5KV2W1qSQQDBU9PiKqf7tBSr3AITu2OGMMq/+COM3k3Qau/2jxZC iAVNHoHTSSrO2SEMoUdXZHkrA320oCTQGrYHmLBG9RyANk/u7tG7Q+rVjZMTRz+7cWa+ Tmf2G3Q8sq90V5gsYAeWwpddVU9hSNkYjmYqNZjAqNq+8n9Y3Ae4jEffukmN/IW8qm1E Ibcjn43gMYAfUm0SsGzm0hXh39d5HKPYgnhA7l65AnpYD/J5edt3NbzLH/8lRjjppqO+ L5zg== X-Gm-Message-State: AOJu0YxhUeLMHJe6+coG8ozugu8GH7gDIude4wscTBMXgxrWkGGx7rpp BVXG4QnuhaTgYPROl7zmI1o= X-Google-Smtp-Source: AGHT+IHlD/qO8tGbkcrrequphqbE+bWk5fe3X8IqFL8JJvOf3xU5m1BnyJwgEqkPib4E+GSUlrX4ng== X-Received: by 2002:a17:90a:ee81:b0:28a:c749:23cf with SMTP id i1-20020a17090aee8100b0028ac74923cfmr2522123pjz.75.1704830780119; Tue, 09 Jan 2024 12:06:20 -0800 (PST) Received: from gnu-cfl-3.localdomain ([172.56.169.119]) by smtp.gmail.com with ESMTPSA id ph3-20020a17090b3bc300b0028d0c8c9d37sm8834945pjb.22.2024.01.09.12.06.19 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 09 Jan 2024 12:06:19 -0800 (PST) Received: from gnu-cfl-3.. (localhost [IPv6:::1]) by gnu-cfl-3.localdomain (Postfix) with ESMTP id CA799740677; Tue, 9 Jan 2024 12:06:18 -0800 (PST) From: "H.J. Lu" To: libc-alpha@sourceware.org Cc: adhemerval.zanella@linaro.org, goldstein.w.n@gmail.com Subject: [PATCH v2 2/4] x86-64/cet: Move dl-cet.[ch] to x86_64 directories Date: Tue, 9 Jan 2024 12:06:16 -0800 Message-ID: <20240109200618.1508659-3-hjl.tools@gmail.com> X-Mailer: git-send-email 2.43.0 In-Reply-To: <20240109200618.1508659-1-hjl.tools@gmail.com> References: <20240109200618.1508659-1-hjl.tools@gmail.com> MIME-Version: 1.0 X-Spam-Status: No, score=-3024.3 required=5.0 tests=BAYES_00, DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, FREEMAIL_FROM, GIT_PATCH_0, KAM_SHORT, RCVD_IN_DNSWL_NONE, SPF_HELO_NONE, SPF_PASS, TXREP, T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org X-BeenThere: libc-alpha@sourceware.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: Libc-alpha mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: libc-alpha-bounces+incoming=patchwork.ozlabs.org@sourceware.org Since CET is only enabled for x86-64, move dl-cet.[ch] to x86_64 directories. --- sysdeps/unix/sysv/linux/x86/dl-cet.h | 63 ------------------------- sysdeps/unix/sysv/linux/x86_64/dl-cet.h | 47 +++++++++++++++++- sysdeps/{x86 => x86_64}/dl-cet.c | 2 +- 3 files changed, 47 insertions(+), 65 deletions(-) delete mode 100644 sysdeps/unix/sysv/linux/x86/dl-cet.h rename sysdeps/{x86 => x86_64}/dl-cet.c (99%) diff --git a/sysdeps/unix/sysv/linux/x86/dl-cet.h b/sysdeps/unix/sysv/linux/x86/dl-cet.h deleted file mode 100644 index c10773ab0e..0000000000 --- a/sysdeps/unix/sysv/linux/x86/dl-cet.h +++ /dev/null @@ -1,63 +0,0 @@ -/* Linux/x86 CET initializers function. - Copyright (C) 2018-2024 Free Software Foundation, Inc. - - The GNU C Library is free software; you can redistribute it and/or - modify it under the terms of the GNU Lesser General Public - License as published by the Free Software Foundation; either - version 2.1 of the License, or (at your option) any later version. - - The GNU C Library is distributed in the hope that it will be useful, - but WITHOUT ANY WARRANTY; without even the implied warranty of - MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU - Lesser General Public License for more details. - - You should have received a copy of the GNU Lesser General Public - License along with the GNU C Library; if not, see - . */ - -#include -#include - -static __always_inline int -dl_cet_disable_cet (unsigned int cet_feature) -{ - if (cet_feature != GNU_PROPERTY_X86_FEATURE_1_SHSTK) - return -1; - long long int kernel_feature = ARCH_SHSTK_SHSTK; - return (int) INTERNAL_SYSCALL_CALL (arch_prctl, ARCH_SHSTK_DISABLE, - kernel_feature); -} - -static __always_inline int -dl_cet_lock_cet (unsigned int cet_feature) -{ - if (cet_feature != GNU_PROPERTY_X86_FEATURE_1_SHSTK) - return -1; - /* Lock all SHSTK features. */ - long long int kernel_feature = -1; - return (int) INTERNAL_SYSCALL_CALL (arch_prctl, ARCH_SHSTK_LOCK, - kernel_feature); -} - -static __always_inline unsigned int -dl_cet_get_cet_status (void) -{ - unsigned long long kernel_feature; - unsigned int status = 0; - if (INTERNAL_SYSCALL_CALL (arch_prctl, ARCH_SHSTK_STATUS, - &kernel_feature) == 0) - { - if ((kernel_feature & ARCH_SHSTK_SHSTK) != 0) - status = GNU_PROPERTY_X86_FEATURE_1_SHSTK; - } - return status; -} - -/* Enable shadow stack with a macro to avoid shadow stack underflow. */ -#define ENABLE_X86_CET(cet_feature) \ - if ((cet_feature & GNU_PROPERTY_X86_FEATURE_1_SHSTK)) \ - { \ - long long int kernel_feature = ARCH_SHSTK_SHSTK; \ - INTERNAL_SYSCALL_CALL (arch_prctl, ARCH_SHSTK_ENABLE, \ - kernel_feature); \ - } diff --git a/sysdeps/unix/sysv/linux/x86_64/dl-cet.h b/sysdeps/unix/sysv/linux/x86_64/dl-cet.h index c89dd6bd42..94e9b9aa86 100644 --- a/sysdeps/unix/sysv/linux/x86_64/dl-cet.h +++ b/sysdeps/unix/sysv/linux/x86_64/dl-cet.h @@ -15,8 +15,53 @@ License along with the GNU C Library; if not, see . */ +#include +#include #include -#include_next + +static __always_inline int +dl_cet_disable_cet (unsigned int cet_feature) +{ + if (cet_feature != GNU_PROPERTY_X86_FEATURE_1_SHSTK) + return -1; + long long int kernel_feature = ARCH_SHSTK_SHSTK; + return (int) INTERNAL_SYSCALL_CALL (arch_prctl, ARCH_SHSTK_DISABLE, + kernel_feature); +} + +static __always_inline int +dl_cet_lock_cet (unsigned int cet_feature) +{ + if (cet_feature != GNU_PROPERTY_X86_FEATURE_1_SHSTK) + return -1; + /* Lock all SHSTK features. */ + long long int kernel_feature = -1; + return (int) INTERNAL_SYSCALL_CALL (arch_prctl, ARCH_SHSTK_LOCK, + kernel_feature); +} + +static __always_inline unsigned int +dl_cet_get_cet_status (void) +{ + unsigned long long kernel_feature; + unsigned int status = 0; + if (INTERNAL_SYSCALL_CALL (arch_prctl, ARCH_SHSTK_STATUS, + &kernel_feature) == 0) + { + if ((kernel_feature & ARCH_SHSTK_SHSTK) != 0) + status = GNU_PROPERTY_X86_FEATURE_1_SHSTK; + } + return status; +} + +/* Enable shadow stack with a macro to avoid shadow stack underflow. */ +#define ENABLE_X86_CET(cet_feature) \ + if ((cet_feature & GNU_PROPERTY_X86_FEATURE_1_SHSTK)) \ + { \ + long long int kernel_feature = ARCH_SHSTK_SHSTK; \ + INTERNAL_SYSCALL_CALL (arch_prctl, ARCH_SHSTK_ENABLE, \ + kernel_feature); \ + } #define X86_STRINGIFY_1(x) #x #define X86_STRINGIFY(x) X86_STRINGIFY_1 (x) diff --git a/sysdeps/x86/dl-cet.c b/sysdeps/x86_64/dl-cet.c similarity index 99% rename from sysdeps/x86/dl-cet.c rename to sysdeps/x86_64/dl-cet.c index d1d42ab002..1297c09f84 100644 --- a/sysdeps/x86/dl-cet.c +++ b/sysdeps/x86_64/dl-cet.c @@ -1,4 +1,4 @@ -/* x86 CET initializers function. +/* x86-64 CET initializers function. Copyright (C) 2018-2024 Free Software Foundation, Inc. The GNU C Library is free software; you can redistribute it and/or From patchwork Tue Jan 9 20:06:17 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "H.J. Lu" X-Patchwork-Id: 1884630 Return-Path: X-Original-To: incoming@patchwork.ozlabs.org Delivered-To: patchwork-incoming@legolas.ozlabs.org Authentication-Results: legolas.ozlabs.org; dkim=pass (2048-bit key; unprotected) header.d=gmail.com header.i=@gmail.com header.a=rsa-sha256 header.s=20230601 header.b=h9geasmT; dkim-atps=neutral Authentication-Results: legolas.ozlabs.org; spf=pass (sender SPF authorized) smtp.mailfrom=sourceware.org (client-ip=2620:52:3:1:0:246e:9693:128c; helo=server2.sourceware.org; envelope-from=libc-alpha-bounces+incoming=patchwork.ozlabs.org@sourceware.org; receiver=patchwork.ozlabs.org) Received: from server2.sourceware.org (server2.sourceware.org [IPv6:2620:52:3:1:0:246e:9693:128c]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (secp384r1) server-digest SHA384) (No client certificate requested) by legolas.ozlabs.org (Postfix) with ESMTPS id 4T8hlx0P9Wz1yPm for ; Wed, 10 Jan 2024 07:06:53 +1100 (AEDT) Received: from server2.sourceware.org (localhost [IPv6:::1]) by sourceware.org (Postfix) with ESMTP id 10CDA3857C4C for ; Tue, 9 Jan 2024 20:06:51 +0000 (GMT) X-Original-To: libc-alpha@sourceware.org Delivered-To: libc-alpha@sourceware.org Received: from mail-pl1-x62c.google.com (mail-pl1-x62c.google.com [IPv6:2607:f8b0:4864:20::62c]) by sourceware.org (Postfix) with ESMTPS id B23B6385843E for ; Tue, 9 Jan 2024 20:06:21 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org B23B6385843E Authentication-Results: sourceware.org; dmarc=pass (p=none dis=none) header.from=gmail.com Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=gmail.com ARC-Filter: OpenARC Filter v1.0.0 sourceware.org B23B6385843E Authentication-Results: server2.sourceware.org; arc=none smtp.remote-ip=2607:f8b0:4864:20::62c ARC-Seal: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1704830783; cv=none; b=AvoPynhRSfJUC0tpDY9yy8KjEnUhu7kggFIAkNgDTQq0wGpV7HcK3Qpmenr5BIw28GbuVdF+XTetkuz+IBTUu/CnHbcr5RXuh8H8LwRbM3r3pHBD2iuyqevLtvy56GhpkqJyFXMEn5ucvXnFVCu6X+URt0VIf8VkDGkYPDVkEmQ= ARC-Message-Signature: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1704830783; c=relaxed/simple; bh=KkImigWzfENbvZU5zKWs32HwY0WJtK/jzwDEsUNKZgg=; h=DKIM-Signature:From:To:Subject:Date:Message-ID:MIME-Version; b=FcfGouUZ8ydVRjV7ope67EzPOTWbiC37bAfqT9zpMqKw924ivv+2zUsNCy0hfkHgQXe5fXxucLt807sJseAKqq+EU4w+onDK0wXl/J0L944juARaxX+AWcABunLTGWwKMynK8TDZlbt+LgneP1Z+fA9967HZrtU8wFdpeSt1gw0= ARC-Authentication-Results: i=1; server2.sourceware.org Received: by mail-pl1-x62c.google.com with SMTP id d9443c01a7336-1d509222c11so11757215ad.1 for ; Tue, 09 Jan 2024 12:06:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1704830781; x=1705435581; darn=sourceware.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=AixZYWaDfYhBUlT04+Hg9ubTR/MnAweIJKimN1ifR2Y=; b=h9geasmT9SwJNI4nNHmyI54g+D1g7lAtygTexyKabadZE3pSNXgnl3JDPVuuH2dtBB X3R536OcUL70vipXuCA54vm5fMQQOQeuALmdlasKx6QfNaXcWYSXH+les5dKpXO7i5GS xtuuu5dq5IelSweG/CGm2d3pP3yDFtK6V14Mu9IpUdl2cA7WY42BqF4N+BxZiM2nFdYE QWOVR/9Ha3ojuorf9nYjmGeGPeQXWT4Zy8ql9n97jGjJ80VxfZnT1gRVz3FJBDKFVOg2 HCjp0Buq/uOdincaFSzMjhArlfzoHoG1QyLXCh6isSnlAo0s+VhEiPlGbuxbMM8tgz/F EyLA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1704830781; x=1705435581; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=AixZYWaDfYhBUlT04+Hg9ubTR/MnAweIJKimN1ifR2Y=; b=gFabFFXPzVJUo0NrF9wD0K6rycOEUhHvq28P8vXsLsKEo0/vvxJVGyfifZH3+hMaXh /u3+P+EvFHNoyyuj2aF00aHhpIj13ukdDqyuj2U1VKQxzk0PneHp5AX04g3Kv3FtyujZ TTHMd7YIrZCjMgyvc+yEKUdC99EotIYwLafnv3Zbb9au9VNwvTtpQj8PXSPWuxExnG+l EYkbCNZlffswFkcneGe+EK7Fnes+A0i5gxdyBO8VWVXGtxe6IimYI08WYzsS8RTNM77i SHMzRnSo3fJH+kyGT3Vjsg27/jDcYvnsL677j0If2DtKgQj+R/emAv3+gURXCXLu7WH2 lvYw== X-Gm-Message-State: AOJu0YwUqQjMGaEhfylSvpempE5IcxvN6EDayGn20ZZaJVC+TuZ03duJ fzOxSYKIvBIcDbsf5komvPSg0kRA2x0= X-Google-Smtp-Source: AGHT+IFYhGsmL3hgCtOmkva7WxDFO3gg3tZG1o5DaQP/BECsMUrojca2jMAMeHfaHCVTjK6ueGLq/Q== X-Received: by 2002:a17:903:120c:b0:1d3:f056:3f57 with SMTP id l12-20020a170903120c00b001d3f0563f57mr3939595plh.13.1704830780703; Tue, 09 Jan 2024 12:06:20 -0800 (PST) Received: from gnu-cfl-3.localdomain ([172.56.169.119]) by smtp.gmail.com with ESMTPSA id n10-20020a1709026a8a00b001d1cd7e4ad2sm2186174plk.125.2024.01.09.12.06.19 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 09 Jan 2024 12:06:20 -0800 (PST) Received: from gnu-cfl-3.. (localhost [IPv6:::1]) by gnu-cfl-3.localdomain (Postfix) with ESMTP id D63FF740678; Tue, 9 Jan 2024 12:06:18 -0800 (PST) From: "H.J. Lu" To: libc-alpha@sourceware.org Cc: adhemerval.zanella@linaro.org, goldstein.w.n@gmail.com Subject: [PATCH v2 3/4] x86-64/cet: Move check-cet.awk to x86_64 Date: Tue, 9 Jan 2024 12:06:17 -0800 Message-ID: <20240109200618.1508659-4-hjl.tools@gmail.com> X-Mailer: git-send-email 2.43.0 In-Reply-To: <20240109200618.1508659-1-hjl.tools@gmail.com> References: <20240109200618.1508659-1-hjl.tools@gmail.com> MIME-Version: 1.0 X-Spam-Status: No, score=-3024.1 required=5.0 tests=BAYES_00, DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, FREEMAIL_FROM, GIT_PATCH_0, KAM_NUMSUBJECT, RCVD_IN_DNSWL_NONE, SPF_HELO_NONE, SPF_PASS, TXREP, T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org X-BeenThere: libc-alpha@sourceware.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: Libc-alpha mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: libc-alpha-bounces+incoming=patchwork.ozlabs.org@sourceware.org --- sysdeps/x86_64/Makefile | 2 +- sysdeps/{x86 => x86_64}/check-cet.awk | 0 2 files changed, 1 insertion(+), 1 deletion(-) rename sysdeps/{x86 => x86_64}/check-cet.awk (100%) diff --git a/sysdeps/x86_64/Makefile b/sysdeps/x86_64/Makefile index 98f0e04f90..abb8b354af 100644 --- a/sysdeps/x86_64/Makefile +++ b/sysdeps/x86_64/Makefile @@ -468,7 +468,7 @@ $(cet-built-dso:=.note): %.note: % mv -f $@T $@ common-generated += $(cet-built-dso:$(common-objpfx)%=%.note) -$(objpfx)check-cet.out: $(..)sysdeps/x86/check-cet.awk \ +$(objpfx)check-cet.out: $(..)/sysdeps/x86_64/check-cet.awk \ $(cet-built-dso:=.note) LC_ALL=C $(AWK) -f $^ > $@; \ $(evaluate-test) diff --git a/sysdeps/x86/check-cet.awk b/sysdeps/x86_64/check-cet.awk similarity index 100% rename from sysdeps/x86/check-cet.awk rename to sysdeps/x86_64/check-cet.awk From patchwork Tue Jan 9 20:06:18 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "H.J. Lu" X-Patchwork-Id: 1884631 Return-Path: X-Original-To: incoming@patchwork.ozlabs.org Delivered-To: patchwork-incoming@legolas.ozlabs.org Authentication-Results: legolas.ozlabs.org; dkim=pass (2048-bit key; unprotected) header.d=gmail.com header.i=@gmail.com header.a=rsa-sha256 header.s=20230601 header.b=PWftisc1; dkim-atps=neutral Authentication-Results: legolas.ozlabs.org; spf=pass (sender SPF authorized) smtp.mailfrom=sourceware.org (client-ip=2620:52:3:1:0:246e:9693:128c; helo=server2.sourceware.org; envelope-from=libc-alpha-bounces+incoming=patchwork.ozlabs.org@sourceware.org; receiver=patchwork.ozlabs.org) Received: from server2.sourceware.org (server2.sourceware.org [IPv6:2620:52:3:1:0:246e:9693:128c]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (secp384r1) server-digest SHA384) (No client certificate requested) by legolas.ozlabs.org (Postfix) with ESMTPS id 4T8hlz1639z1yPm for ; Wed, 10 Jan 2024 07:06:55 +1100 (AEDT) Received: from server2.sourceware.org (localhost [IPv6:::1]) by sourceware.org (Postfix) with ESMTP id 25B663857831 for ; Tue, 9 Jan 2024 20:06:53 +0000 (GMT) X-Original-To: libc-alpha@sourceware.org Delivered-To: libc-alpha@sourceware.org Received: from mail-pj1-x102d.google.com (mail-pj1-x102d.google.com [IPv6:2607:f8b0:4864:20::102d]) by sourceware.org (Postfix) with ESMTPS id 9191F385840F for ; Tue, 9 Jan 2024 20:06:21 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org 9191F385840F Authentication-Results: sourceware.org; dmarc=pass (p=none dis=none) header.from=gmail.com Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=gmail.com ARC-Filter: OpenARC Filter v1.0.0 sourceware.org 9191F385840F Authentication-Results: server2.sourceware.org; arc=none smtp.remote-ip=2607:f8b0:4864:20::102d ARC-Seal: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1704830784; cv=none; b=uS/7jtWfkC/dyBTNS8qiNGD9aWnMfKkTLf5VRcmxa5k2u9slJ1NDKXZDufYKL0j5ViaP1s3cDdoqy6zIren81R/VhV44Y1Z75AJ8WIJVMmkNjA+7e6jIHR6CirHlffSvTXDMlkAypGF063KtBIsbMcwUKggU86jOCE22sFZPerM= ARC-Message-Signature: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1704830784; c=relaxed/simple; bh=cyRrAaUTGRT7ITC9sfyGcIpI5A8oVeNKhD+dG5zdH4I=; h=DKIM-Signature:From:To:Subject:Date:Message-ID:MIME-Version; b=Ez2boxSWghy3rf90zpmEKTTPCoGN/WwtzjE43OA4Sn91QoEN6mm5n2Kh9meJxf56wdrIrDe/SPsxidGE7TzRRAWQvYAT1JwtdKWJKn9HzCGviXa5wMt7ENTS0gpDA/FOkEyoIfqyILbbAza+izrWJPASLDyMuvvAeF+iWWcA4u8= ARC-Authentication-Results: i=1; server2.sourceware.org Received: by mail-pj1-x102d.google.com with SMTP id 98e67ed59e1d1-28d0052beb0so2240722a91.0 for ; Tue, 09 Jan 2024 12:06:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1704830780; x=1705435580; darn=sourceware.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=UnkMEZN1A/5C89EGbptdRnP2/X3HJy8ZuoiZscH4lbU=; b=PWftisc14+MjjUEegsllOgBc34BbtCKXj1XGbtx0tIgNIg7RLjUq+ZHzRj9NqWQY12 FOz8JllwBlyJeeiMpTddYuxOv95TbUCoLC0bkq0paHEuEttUR12i1FYZ8j1ZXokB1+5Q 51JFmB5GvuoE9AysiuOToGBTzjzcOaInqY/CviANNw1jp1ztPXBSse0MZpers8M6vwIc pAmqk/6R8v6W9+rHOiHP3EmM2EPaZBFoyCxIAlkHTcwbsG4zQUGRyaZu4Ki7V69TbH4e ypy+HLzt4gQ63LfXzpyWMTLpA5GbiLX4XJXSjUaczbELFxE1OSv8zwNA7QntnSVkpavp Erlw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1704830780; x=1705435580; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=UnkMEZN1A/5C89EGbptdRnP2/X3HJy8ZuoiZscH4lbU=; b=K1J3zfWeyNmP5kQ7riZbZw2Ai592cXEy8MktG5/fhmHMmZq3nl5LIs+s6eCtkCHSXZ rT/XAk60hB/CeojPOPxl5LP2yuhS/RkFsZGViYXmhge8mJvnLR+s/IFmS11kzGWSdybU YsPnMvrYDtRCDeptxTXSInngffEbVR8eY0c6H8R2wRgZ1wknpYkveMR93tW2L2+7wCsm oC82cZHBy+rnMLoup3hDJSF9YnHR+KLczIJ/R716sTEhDXIHfuHyAVFkpM5vXJ8apqo+ fIa8wpWhuKhzYHMmyXNwGdmNtc5sexm167Ru7aD/HmOzSZuWVdOfQD1ihhL1jEiwrNxm 5Nmw== X-Gm-Message-State: AOJu0YzHmtFIZoyMyi+2ZvaSayWRXnGPwhEZqnFwAqTXcwRtRQss6pFM wyBnbe8nhkqKsoXm3BzSABc= X-Google-Smtp-Source: AGHT+IFDiCulISMRINeh+cuxmYDW484GnXyFYUNN2otjKsdash1QuNwcm2pYrbHEjU+/wHJItND2Qg== X-Received: by 2002:a17:90a:b88a:b0:28d:29ff:3064 with SMTP id o10-20020a17090ab88a00b0028d29ff3064mr2309136pjr.16.1704830780414; Tue, 09 Jan 2024 12:06:20 -0800 (PST) Received: from gnu-cfl-3.localdomain ([172.56.169.119]) by smtp.gmail.com with ESMTPSA id gq22-20020a17090b105600b0028b89520c7asm2415024pjb.9.2024.01.09.12.06.19 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 09 Jan 2024 12:06:20 -0800 (PST) Received: from gnu-cfl-3.. (localhost [IPv6:::1]) by gnu-cfl-3.localdomain (Postfix) with ESMTP id E35D2740679; Tue, 9 Jan 2024 12:06:18 -0800 (PST) From: "H.J. Lu" To: libc-alpha@sourceware.org Cc: adhemerval.zanella@linaro.org, goldstein.w.n@gmail.com Subject: [PATCH v2 4/4] i386: Remove CET support bits Date: Tue, 9 Jan 2024 12:06:18 -0800 Message-ID: <20240109200618.1508659-5-hjl.tools@gmail.com> X-Mailer: git-send-email 2.43.0 In-Reply-To: <20240109200618.1508659-1-hjl.tools@gmail.com> References: <20240109200618.1508659-1-hjl.tools@gmail.com> MIME-Version: 1.0 X-Spam-Status: No, score=-3024.3 required=5.0 tests=BAYES_00, DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, FREEMAIL_FROM, GIT_PATCH_0, KAM_SHORT, RCVD_IN_DNSWL_NONE, SPF_HELO_NONE, SPF_PASS, TXREP, T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org X-BeenThere: libc-alpha@sourceware.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: Libc-alpha mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: libc-alpha-bounces+incoming=patchwork.ozlabs.org@sourceware.org 1. Remove _dl_runtime_resolve_shstk and _dl_runtime_profile_shstk. 2. Move CET offsets from x86 cpu-features-offsets.sym to x86-64 features-offsets.sym. 3. Rename x86 cet-control.h to x86-64 feature-control.h since it is only for x86-64 and also used for PLT rewrite. 4. Add x86-64 ldsodefs.h to include feature-control.h. 5. Change TUNABLE_CALLBACK (set_plt_rewrite) to x86-64 only. 6. Move x86 dl-procruntime.c to x86-64. --- sysdeps/i386/dl-machine.h | 11 +-- sysdeps/i386/dl-trampoline.S | 69 ------------------- sysdeps/unix/sysv/linux/x86_64/dl-cet.h | 2 +- sysdeps/x86/cpu-features-offsets.sym | 2 - sysdeps/x86/cpu-features.c | 4 +- sysdeps/x86/ldsodefs.h | 1 - sysdeps/x86_64/Makefile | 2 +- sysdeps/{x86 => x86_64}/dl-procruntime.c | 2 +- sysdeps/x86_64/dl-trampoline.S | 1 + .../feature-control.h} | 8 +-- sysdeps/x86_64/features-offsets.sym | 6 ++ sysdeps/x86_64/ldsodefs.h | 26 +++++++ 12 files changed, 45 insertions(+), 89 deletions(-) rename sysdeps/{x86 => x86_64}/dl-procruntime.c (97%) rename sysdeps/{x86/cet-control.h => x86_64/feature-control.h} (92%) create mode 100644 sysdeps/x86_64/features-offsets.sym create mode 100644 sysdeps/x86_64/ldsodefs.h diff --git a/sysdeps/i386/dl-machine.h b/sysdeps/i386/dl-machine.h index c69ae165ac..fc1ef96587 100644 --- a/sysdeps/i386/dl-machine.h +++ b/sysdeps/i386/dl-machine.h @@ -65,9 +65,6 @@ elf_machine_runtime_setup (struct link_map *l, struct r_scope_elem *scope[], extern void _dl_runtime_profile (Elf32_Word) attribute_hidden; extern void _dl_runtime_resolve_shstk (Elf32_Word) attribute_hidden; extern void _dl_runtime_profile_shstk (Elf32_Word) attribute_hidden; - /* Check if SHSTK is enabled by kernel. */ - bool shstk_enabled - = (GL(dl_x86_feature_1) & GNU_PROPERTY_X86_FEATURE_1_SHSTK) != 0; if (l->l_info[DT_JMPREL] && lazy) { @@ -95,9 +92,7 @@ elf_machine_runtime_setup (struct link_map *l, struct r_scope_elem *scope[], #ifdef SHARED if (__glibc_unlikely (profile)) { - got[2] = (shstk_enabled - ? (Elf32_Addr) &_dl_runtime_profile_shstk - : (Elf32_Addr) &_dl_runtime_profile); + got[2] = (Elf32_Addr) &_dl_runtime_profile; if (GLRO(dl_profile) != NULL && _dl_name_match_p (GLRO(dl_profile), l)) @@ -109,9 +104,7 @@ elf_machine_runtime_setup (struct link_map *l, struct r_scope_elem *scope[], #endif /* This function will get called to fix up the GOT entry indicated by the offset on the stack, and then jump to the resolved address. */ - got[2] = (shstk_enabled - ? (Elf32_Addr) &_dl_runtime_resolve_shstk - : (Elf32_Addr) &_dl_runtime_resolve); + got[2] = (Elf32_Addr) &_dl_runtime_resolve; } return lazy; diff --git a/sysdeps/i386/dl-trampoline.S b/sysdeps/i386/dl-trampoline.S index 2632020145..6c14d463b6 100644 --- a/sysdeps/i386/dl-trampoline.S +++ b/sysdeps/i386/dl-trampoline.S @@ -44,76 +44,7 @@ _dl_runtime_resolve: cfi_endproc .size _dl_runtime_resolve, .-_dl_runtime_resolve -# The SHSTK compatible version. - .text - .globl _dl_runtime_resolve_shstk - .type _dl_runtime_resolve_shstk, @function - cfi_startproc - .align 16 -_dl_runtime_resolve_shstk: - cfi_adjust_cfa_offset (8) - pushl %eax # Preserve registers otherwise clobbered. - cfi_adjust_cfa_offset (4) - pushl %edx - cfi_adjust_cfa_offset (4) - movl 12(%esp), %edx # Copy args pushed by PLT in register. Note - movl 8(%esp), %eax # that `fixup' takes its parameters in regs. - call _dl_fixup # Call resolver. - movl (%esp), %edx # Get register content back. - movl %eax, %ecx # Store the function address. - movl 4(%esp), %eax # Get register content back. - addl $16, %esp # Adjust stack: PLT1 + PLT2 + %eax + %edx - cfi_adjust_cfa_offset (-16) - jmp *%ecx # Jump to function address. - cfi_endproc - .size _dl_runtime_resolve_shstk, .-_dl_runtime_resolve_shstk - #if !defined PROF && defined SHARED -# The SHSTK compatible version. - .globl _dl_runtime_profile_shstk - .type _dl_runtime_profile_shstk, @function - cfi_startproc - .align 16 -_dl_runtime_profile_shstk: - cfi_adjust_cfa_offset (8) - pushl %esp - cfi_adjust_cfa_offset (4) - addl $8, (%esp) # Account for the pushed PLT data - pushl %ebp - cfi_adjust_cfa_offset (4) - pushl %eax # Preserve registers otherwise clobbered. - cfi_adjust_cfa_offset (4) - pushl %ecx - cfi_adjust_cfa_offset (4) - pushl %edx - cfi_adjust_cfa_offset (4) - movl %esp, %ecx - subl $8, %esp - cfi_adjust_cfa_offset (8) - movl $-1, 4(%esp) - leal 4(%esp), %edx - movl %edx, (%esp) - pushl %ecx # Address of the register structure - cfi_adjust_cfa_offset (4) - movl 40(%esp), %ecx # Load return address - movl 36(%esp), %edx # Copy args pushed by PLT in register. Note - movl 32(%esp), %eax # that `fixup' takes its parameters in regs. - call _dl_profile_fixup # Call resolver. - cfi_adjust_cfa_offset (-8) - movl (%esp), %edx - testl %edx, %edx - jns 1f - movl 4(%esp), %edx # Get register content back. - movl %eax, %ecx # Store the function address. - movl 12(%esp), %eax # Get register content back. - # Adjust stack: PLT1 + PLT2 + %esp + %ebp + %eax + %ecx + %edx - # + free. - addl $32, %esp - cfi_adjust_cfa_offset (-32) - jmp *%ecx # Jump to function address. - cfi_endproc - .size _dl_runtime_profile_shstk, .-_dl_runtime_profile_shstk - .globl _dl_runtime_profile .type _dl_runtime_profile, @function cfi_startproc diff --git a/sysdeps/unix/sysv/linux/x86_64/dl-cet.h b/sysdeps/unix/sysv/linux/x86_64/dl-cet.h index 94e9b9aa86..a00c7ee662 100644 --- a/sysdeps/unix/sysv/linux/x86_64/dl-cet.h +++ b/sysdeps/unix/sysv/linux/x86_64/dl-cet.h @@ -17,7 +17,7 @@ #include #include -#include +#include static __always_inline int dl_cet_disable_cet (unsigned int cet_feature) diff --git a/sysdeps/x86/cpu-features-offsets.sym b/sysdeps/x86/cpu-features-offsets.sym index 5429f60632..6a8fd29813 100644 --- a/sysdeps/x86/cpu-features-offsets.sym +++ b/sysdeps/x86/cpu-features-offsets.sym @@ -2,6 +2,4 @@ #include -RTLD_GLOBAL_RO_DL_X86_CPU_FEATURES_OFFSET offsetof (struct rtld_global_ro, _dl_x86_cpu_features) XSAVE_STATE_SIZE_OFFSET offsetof (struct cpu_features, xsave_state_size) -RTLD_GLOBAL_DL_X86_FEATURE_1_OFFSET offsetof (struct rtld_global, _dl_x86_feature_1) diff --git a/sysdeps/x86/cpu-features.c b/sysdeps/x86/cpu-features.c index 9ca307f521..46bdaffbc2 100644 --- a/sysdeps/x86/cpu-features.c +++ b/sysdeps/x86/cpu-features.c @@ -27,7 +27,7 @@ extern void TUNABLE_CALLBACK (set_hwcaps) (tunable_val_t *) attribute_hidden; -#ifdef SHARED +#if defined SHARED && defined __x86_64__ static void TUNABLE_CALLBACK (set_plt_rewrite) (tunable_val_t *valp) { @@ -1125,8 +1125,10 @@ no_cpuid: #endif #ifdef SHARED +# ifdef __x86_64__ TUNABLE_GET (plt_rewrite, tunable_val_t *, TUNABLE_CALLBACK (set_plt_rewrite)); +# endif #else /* NB: In libc.a, call init_cacheinfo. */ init_cacheinfo (); diff --git a/sysdeps/x86/ldsodefs.h b/sysdeps/x86/ldsodefs.h index b2a6d71513..50dc81c022 100644 --- a/sysdeps/x86/ldsodefs.h +++ b/sysdeps/x86/ldsodefs.h @@ -61,7 +61,6 @@ struct La_x32_retval; struct La_x86_64_retval *, \ const char *) -#include #include_next #endif diff --git a/sysdeps/x86_64/Makefile b/sysdeps/x86_64/Makefile index abb8b354af..10a253e4f1 100644 --- a/sysdeps/x86_64/Makefile +++ b/sysdeps/x86_64/Makefile @@ -10,7 +10,7 @@ LDFLAGS-rtld += -Wl,-z,nomark-plt endif ifeq ($(subdir),csu) -gen-as-const-headers += link-defines.sym +gen-as-const-headers += features-offsets.sym link-defines.sym endif ifeq ($(subdir),gmon) diff --git a/sysdeps/x86/dl-procruntime.c b/sysdeps/x86_64/dl-procruntime.c similarity index 97% rename from sysdeps/x86/dl-procruntime.c rename to sysdeps/x86_64/dl-procruntime.c index 15b3d0d878..7078581778 100644 --- a/sysdeps/x86/dl-procruntime.c +++ b/sysdeps/x86_64/dl-procruntime.c @@ -1,4 +1,4 @@ -/* Data for processor runtime information. x86 version. +/* Data for processor runtime information. x86-64 version. Copyright (C) 2018-2024 Free Software Foundation, Inc. This file is part of the GNU C Library. diff --git a/sysdeps/x86_64/dl-trampoline.S b/sysdeps/x86_64/dl-trampoline.S index 4c1ba5c9af..b2e7e0f69b 100644 --- a/sysdeps/x86_64/dl-trampoline.S +++ b/sysdeps/x86_64/dl-trampoline.S @@ -19,6 +19,7 @@ #include #include #include +#include #include #include diff --git a/sysdeps/x86/cet-control.h b/sysdeps/x86_64/feature-control.h similarity index 92% rename from sysdeps/x86/cet-control.h rename to sysdeps/x86_64/feature-control.h index f09f193e9b..4c8727e844 100644 --- a/sysdeps/x86/cet-control.h +++ b/sysdeps/x86_64/feature-control.h @@ -1,4 +1,4 @@ -/* x86 CET tuning. +/* x86-64 feature tuning. This file is part of the GNU C Library. Copyright (C) 2018-2024 Free Software Foundation, Inc. @@ -16,8 +16,8 @@ License along with the GNU C Library; if not, see . */ -#ifndef _CET_CONTROL_H -#define _CET_CONTROL_H +#ifndef _X86_64_FEATURE_CONTROL_H +#define _X86_64_FEATURE_CONTROL_H /* For each CET feature, IBT and SHSTK, valid control values. */ enum dl_x86_cet_control @@ -50,4 +50,4 @@ struct dl_x86_feature_control enum dl_plt_rewrite_control plt_rewrite : 2; }; -#endif /* cet-control.h */ +#endif /* feature-control.h */ diff --git a/sysdeps/x86_64/features-offsets.sym b/sysdeps/x86_64/features-offsets.sym new file mode 100644 index 0000000000..9e4be3393a --- /dev/null +++ b/sysdeps/x86_64/features-offsets.sym @@ -0,0 +1,6 @@ +#define SHARED 1 + +#include + +RTLD_GLOBAL_RO_DL_X86_CPU_FEATURES_OFFSET offsetof (struct rtld_global_ro, _dl_x86_cpu_features) +RTLD_GLOBAL_DL_X86_FEATURE_1_OFFSET offsetof (struct rtld_global, _dl_x86_feature_1) diff --git a/sysdeps/x86_64/ldsodefs.h b/sysdeps/x86_64/ldsodefs.h new file mode 100644 index 0000000000..0f468ddf5b --- /dev/null +++ b/sysdeps/x86_64/ldsodefs.h @@ -0,0 +1,26 @@ +/* Run-time dynamic linker data structures for loaded ELF shared objects. + x86-64 version. + Copyright (C) 2024 Free Software Foundation, Inc. + This file is part of the GNU C Library. + + The GNU C Library is free software; you can redistribute it and/or + modify it under the terms of the GNU Lesser General Public + License as published by the Free Software Foundation; either + version 2.1 of the License, or (at your option) any later version. + + The GNU C Library is distributed in the hope that it will be useful, + but WITHOUT ANY WARRANTY; without even the implied warranty of + MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + Lesser General Public License for more details. + + You should have received a copy of the GNU Lesser General Public + License along with the GNU C Library; if not, see + . */ + +#ifndef _X86_64_LDSODEFS_H +#define _X86_64_LDSODEFS_H 1 + +#include +#include_next + +#endif