From patchwork Mon Oct 19 12:54:53 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Anup Patel X-Patchwork-Id: 1384294 Return-Path: X-Original-To: incoming@patchwork.ozlabs.org Delivered-To: patchwork-incoming@bilbo.ozlabs.org Authentication-Results: ozlabs.org; spf=none (no SPF record) smtp.mailfrom=lists.infradead.org (client-ip=2001:8b0:10b:1231::1; helo=merlin.infradead.org; envelope-from=opensbi-bounces+incoming=patchwork.ozlabs.org@lists.infradead.org; receiver=) Authentication-Results: ozlabs.org; dmarc=fail (p=none dis=none) header.from=wdc.com Authentication-Results: ozlabs.org; dkim=pass (2048-bit key; secure) header.d=lists.infradead.org header.i=@lists.infradead.org header.a=rsa-sha256 header.s=merlin.20170209 header.b=LqnsS0Hi; dkim=permerror header.d=wdc.com header.i=@wdc.com header.a=rsa-sha1 header.s=dkim.wdc.com header.b=NnNP7v3T; dkim=fail reason="signature verification failed" (1024-bit key; unprotected) header.d=sharedspace.onmicrosoft.com header.i=@sharedspace.onmicrosoft.com header.a=rsa-sha256 header.s=selector2-sharedspace-onmicrosoft-com header.b=C6X42qh0; dkim-atps=neutral Received: from merlin.infradead.org (merlin.infradead.org [IPv6:2001:8b0:10b:1231::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by ozlabs.org (Postfix) with ESMTPS id 4CFGwZ1kLfz9sTr for ; Mon, 19 Oct 2020 23:56:30 +1100 (AEDT) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=merlin.20170209; h=Sender:Content-Transfer-Encoding: Content-Type:Cc:List-Subscribe:List-Help:List-Post:List-Archive: List-Unsubscribe:List-Id:MIME-Version:References:In-Reply-To:Message-Id:Date: Subject:To:From:Reply-To:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=pg+pfuJkwLf0IulEVlhG2DZgQCkk521PLQE82QiaaEY=; b=LqnsS0Hi+ReaobVFMWXrrtFNK jDXd+QeyxxBGN0UcOg4s0eeu365x9pXC/dTVm1skpJ3kTElKHuZnPa8XJ9io63EKCj++Qmzbr9Ruk tLZ09iqZGSn428nYUzMBal7FH6Jrrbc5wJijsxrD3lAho0Fe7N/UNcwnrUGy5ccCu2S9Z2rDrRd+a ufvgTLnOD3DpuXZHifNlWu6SLfGthSWoiRzkPweBqP9rcXXMpq0SXCX+HB1azbMxRIiY2ZSMIZaQJ bbpO29gjReFH9pJhNtM2/WFmNytnoWFXWc1GwoUi91h4AIUbayMo7+2lHfQ2zmSzyNZTccJX7yVXn MgFTv0XLA==; Received: from localhost ([::1] helo=merlin.infradead.org) by merlin.infradead.org with esmtp (Exim 4.92.3 #3 (Red Hat Linux)) id 1kUUi2-0005FV-Am; Mon, 19 Oct 2020 12:56:18 +0000 Received: from esa2.hgst.iphmx.com ([68.232.143.124]) by merlin.infradead.org with esmtps (Exim 4.92.3 #3 (Red Hat Linux)) id 1kUUhv-00059B-KW for opensbi@lists.infradead.org; Mon, 19 Oct 2020 12:56:14 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=wdc.com; i=@wdc.com; q=dns/txt; s=dkim.wdc.com; t=1603112860; x=1634648860; h=from:to:cc:subject:date:message-id:in-reply-to: references:content-transfer-encoding:mime-version; bh=3XC4cAYUSGKm5rNI8Xq5wxb886i3wDvpqRs50SXERXo=; b=NnNP7v3TkYBZdZUVMk+BvxThE42zD/UdN7oJ6NNKYBsH6Xysxy7AMYZS uuCKOxPvEP1BaG4TQBL87Jru5/n0v2te10YpY8kQjsr0OanfhY4q/ikdW fMT7xA2/XRSeW0eEs6M4qvAZ5nFS54sjeS52xvtynk5j84qqW0kri8r/4 8pw5IE3JBiHlVnilluVUbgfC7Y7H1gqpKECORS+Z7TQgXuEYM+tCKYAL6 aox/7qYGTcIHy9OAW4bscuQFmAzmOR7/mFyOLnpZilvDOfLj5mfzXVoU7 viliYtTTSs+gRFHzQDcVU3RUzW8/WYzQwKCKGQ2KHX233EdcjurzkOLEg g==; IronPort-SDR: TByWGPMtZn07HU55FlOV7wx7AJDuyawFLQWjffgnPd34b8pJVvIicJo3HWrp3gM3a/tEQiP14z rMoseIKbB4jgQkZk2KJU+iS0UnGU9OBZHXoA8kvg3FW9EVFMK1TCq9cbCUWQCTJH1CJp5K6jEH tz6pUoxq/uIuTwGRC0C6JMi84K2Pg0ZnZ660VbheNylvb9C0jv6LHw7oaLjiNQj34DLQ/AR2/w H/V3twzRPEm3h8I7HEKMZHh2vWZlEBQ4t7oxkvIwPLkWiKt90PSGmgvzSW934/+MrZhqNojcGf 4o4= X-IronPort-AV: E=Sophos;i="5.77,394,1596470400"; d="scan'208";a="253808658" Received: from mail-cys01nam02lp2057.outbound.protection.outlook.com (HELO NAM02-CY1-obe.outbound.protection.outlook.com) ([104.47.37.57]) by ob1.hgst.iphmx.com with ESMTP; 19 Oct 2020 21:07:36 +0800 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Xsz3vmWmozB6CUr5UnIGHo0dQrviD5a2Ya7UF01sPssRwehFU6xd9qGRF0pSvmoT7aqOIS72jmOqQInSDy1ETs+pjE4+SzLU/ygU7EaMxb92Zy3zYgNYKOB+jUR2djR86T83mvrb9aN/dFbAwN7fUEQ8h6BambZsEeEHox1LWed+UWJiLBvtF2GkeaI+d5BAukWFuatEkl0UHeMdiT/cSRh2+T/KcogrI9aAicBb5bMpFIXdpwv+VNh4LM6VZAxGSwAL1rOLvrIeoMotJOE2XZTAlDZON7f2tOCGMi5y7jKT865GPIMyjWwYqeapCEIS2JSB1imgGMfDhx1lYs6xHw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=EmItzTUeqVaiun5cQrQ+KWjND4FnLA2Rv1c2ESXBSgM=; b=XnOz/2F0z09e90VZfXyR1olORJn6wCh6gvgscN0SYuIJf1jsCKia3MF0MelqVxxPFT84vwu4IGTXnVenvybxgUoVn23c/oqzmJTPdVN4IK8vbuI6YxfT53jznKHSMq73R04ki5OjIq0k4MOuG1cVyxWQ1Pu5diBKMnHXspM4YlCyPuYKqnDxs2JRQbbNjlSWs4SAfKKf/ceu6HnqQTJM9B3Ya4h9kT2T7/ZVg4JJEAEg6FIAL2M+do3G8VOvYEvwftv5XbqP26rOfqaGUr7nczHDB1bER8aAg40sQVEtLE3cM3dFiU9wdXfMBszrol+IksCUlAojlWcGu3Sxlq00Uw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=wdc.com; dmarc=pass action=none header.from=wdc.com; dkim=pass header.d=wdc.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sharedspace.onmicrosoft.com; s=selector2-sharedspace-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=EmItzTUeqVaiun5cQrQ+KWjND4FnLA2Rv1c2ESXBSgM=; b=C6X42qh0kYRchjp0+mViU9laU9LbSqHo0LrZG5ys0F4s9wlH5JTlSU8BccC3sZinddWutPtqkiRp9guL6UtpX0+yKUtrG+WctZxhxktzs2ttwc0u3k0h/Wx7dXhLpHbIO6e3S1TOBj5rJqp9IkPs/uaXpZ4qqHajes+nhL0fc80= Authentication-Results: wdc.com; dkim=none (message not signed) header.d=none;wdc.com; dmarc=none action=none header.from=wdc.com; Received: from DM6PR04MB6201.namprd04.prod.outlook.com (2603:10b6:5:127::32) by DM6PR04MB5548.namprd04.prod.outlook.com (2603:10b6:5:12a::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3477.27; Mon, 19 Oct 2020 12:56:07 +0000 Received: from DM6PR04MB6201.namprd04.prod.outlook.com ([fe80::d035:e2c6:c11:51dd]) by DM6PR04MB6201.namprd04.prod.outlook.com ([fe80::d035:e2c6:c11:51dd%6]) with mapi id 15.20.3477.028; Mon, 19 Oct 2020 12:56:07 +0000 From: Anup Patel To: Atish Patra , Alistair Francis Subject: [PATCH v3 16/16] docs: Add initial documentation for domain support Date: Mon, 19 Oct 2020 18:24:53 +0530 Message-Id: <20201019125453.2460105-17-anup.patel@wdc.com> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20201019125453.2460105-1-anup.patel@wdc.com> References: <20201019125453.2460105-1-anup.patel@wdc.com> X-Originating-IP: [122.172.253.92] X-ClientProxiedBy: MAXPR0101CA0060.INDPRD01.PROD.OUTLOOK.COM (2603:1096:a00:e::22) To DM6PR04MB6201.namprd04.prod.outlook.com (2603:10b6:5:127::32) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from wdc.com (122.172.253.92) by MAXPR0101CA0060.INDPRD01.PROD.OUTLOOK.COM (2603:1096:a00:e::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3477.21 via Frontend Transport; Mon, 19 Oct 2020 12:56:05 +0000 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-HT: Tenant X-MS-Office365-Filtering-Correlation-Id: 3a69f78a-87e9-4789-0378-08d8742e5851 X-MS-TrafficTypeDiagnostic: DM6PR04MB5548: X-MS-Exchange-Transport-Forked: True X-Microsoft-Antispam-PRVS: WDCIPOUTBOUND: EOP-TRUE X-MS-Oob-TLC-OOBClassifiers: OLM:9508; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: MjyrORyzVhoiIA4Bd+i3M/02vJj1dJjAVe21ZKPEtQzcou7oWj+NgZj6TqeIFZlft/Y8FyF5sZPOfFLA82PWt34ACHAWjmTwGisJHVrZ3zAaX16GgQue4MF7IlojjsR9Tgu/K12WsmTybOSCBg4aVFN26AJ1HX4Kxp7xbCpN3CS+/8vSqNEXhi+45KY0s3ns0NRoWWrm7EneBXYjouOsPGDjotCfxWmg/ryJskbzlG6uiuv19dJq5EYQdn7lwfCIf9UU/uE6mG8Rg6ei88nm4Ht1jvB9LtcQEgWVjPfuGCX/keHpoWpFr6p8+DG4tZykYkAzqkzp9mTP+oHL6/OhfoEHRS0IkQnFHDRJg8jYUoC9gR0Al5WtIxzkmBU8XMVH1T2Am6qoUIwzzU/QwZgX8Sz438A5dfGBa3iwessR2M/QYU9YM9wyDLOXfR5+FIrknuO9YHf+dshYlfEySf1+gZq5naEY897oX7BFRsX+CA0= X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DM6PR04MB6201.namprd04.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(366004)(136003)(396003)(376002)(346002)(39860400002)(6636002)(55016002)(6666004)(8886007)(66946007)(66476007)(8936002)(8676002)(66556008)(2906002)(86362001)(44832011)(83380400001)(2616005)(966005)(956004)(16526019)(5660300002)(19273905006)(186003)(54906003)(110136005)(52116002)(7696005)(55236004)(1076003)(4326008)(478600001)(316002)(36756003)(26005)(562404015)(563064011); DIR:OUT; SFP:1102; X-MS-Exchange-AntiSpam-MessageData: MoC89g33raWzEygIcGnojdX6YvmbEeNhdfptMQsVDugEvfTnRynl355SVt5iQeaHm7FTQEH0RxGslH1yyLD0EqcZRaQ7624Akmbi5aa8npM+l6tfv1ry+LeCjgKeCNedeLG2K6fbDCdzqg6vkP84SAijRvXm847Y65T1xi9beKPgIGyWJJh79ZKdZTmlTBMi/JZZIuh0HoKK0ck0UbgFaB5o5gAc/aLs4jildpNreZGvjcwh3bh9bgdZKqN1HNRCzoul8MXRVqjHtAttsiE8FFeXfKw61HVTDWcubdrl8TY9vo0oDzdU7zjZWA1wa7cHNvSDqpbD+wil2jfLKKEA15qhzD+O52ZtQk0PKBINWkL3x8rpFhIkj5StbXVp537VI3oLDuvGUbb5mTIDPTHFhFShRGk8go38KrY+OaXmfYDsBs+C0TQDJiiGgjfzwsuvJvWi/8QTEoL7CvILsN/ZhT5ybNXdwuwil5sLP0kFMzmkMwjrQGw/cOrKGWJEjx/h2WABTBdCul0ekut/NAw7QYxrr74GqBCHma/T//JSTzFfPWNdmCzNXruzsABFz4DPENCSoPIjfeniktPfVw4uBV3aOURZrV/nUZz3gnPgLwvcBgBophqSldgHz0ARu1TWX7BwxArnaG/FIE2824kpng== X-OriginatorOrg: wdc.com X-MS-Exchange-CrossTenant-Network-Message-Id: 3a69f78a-87e9-4789-0378-08d8742e5851 X-MS-Exchange-CrossTenant-AuthSource: DM6PR04MB6201.namprd04.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 19 Oct 2020 12:56:07.4585 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: b61c8803-16f3-4c35-9b17-6f65f441df86 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: wXKiMcuJf1wUvUtU1WncUP38XFd773UiOwONBCLdKft0qO5uH00IDProMjIOAEeLs3FD2snpvPsrPZJlFsL6tQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR04MB5548 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20201019_085611_860735_51250BC5 X-CRM114-Status: GOOD ( 27.60 ) X-Spam-Score: -2.5 (--) X-Spam-Report: SpamAssassin version 3.4.4 on merlin.infradead.org summary: Content analysis details: (-2.5 points) pts rule name description ---- ---------------------- -------------------------------------------------- -2.3 RCVD_IN_DNSWL_MED RBL: Sender listed at https://www.dnswl.org/, medium trust [68.232.143.124 listed in list.dnswl.org] -0.0 SPF_PASS SPF: sender matches SPF record -0.0 SPF_HELO_PASS SPF: HELO matches SPF record -0.1 DKIM_VALID_EF Message has a valid DKIM or DK signature from envelope-from domain -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily valid -0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from author's domain 0.0 MSGID_FROM_MTA_HEADER Message-Id was added by a relay X-BeenThere: opensbi@lists.infradead.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Anup Patel , Anup Patel , opensbi@lists.infradead.org Sender: "opensbi" Errors-To: opensbi-bounces+incoming=patchwork.ozlabs.org@lists.infradead.org We add initial documentation for OpenSBI domain support to help RISC-V platform vendors achieve system-level partitioning. Signed-off-by: Anup Patel Reviewed-by: Atish Patra --- README.md | 3 ++ docs/domain_support.md | 106 +++++++++++++++++++++++++++++++++++++++++ docs/doxygen.cfg | 1 + 3 files changed, 110 insertions(+) create mode 100644 docs/domain_support.md diff --git a/README.md b/README.md index bd41ba3..03c02fb 100644 --- a/README.md +++ b/README.md @@ -225,6 +225,8 @@ Detailed documentation of various aspects of OpenSBI can be found under the * [Platform Documentation]: Documentation of the platforms currently supported. * [Firmware Documentation]: Documentation for the different types of firmware examples build supported by OpenSBI. +* [Domain Support]: Documentation for the OpenSBI domain support which helps + users achieve system-level partitioning using OpenSBI. OpenSBI source code is also well documented. For source level documentation, doxygen style is used. Please refer to the [Doxygen manual] for details on this @@ -278,6 +280,7 @@ make I= install_docs [Platform Support Guide]: docs/platform_guide.md [Platform Documentation]: docs/platform/platform.md [Firmware Documentation]: docs/firmware/fw.md +[Domain Support]: docs/domain_support.md [Doxygen manual]: http://www.doxygen.nl/manual/index.html [Kendryte standalone SDK]: https://github.com/kendryte/kendryte-standalone-sdk [third party notices]: ThirdPartyNotices.md diff --git a/docs/domain_support.md b/docs/domain_support.md new file mode 100644 index 0000000..53967dd --- /dev/null +++ b/docs/domain_support.md @@ -0,0 +1,106 @@ +OpenSBI Domain Support +====================== + +An OpenSBI domain is a system-level partition (subset) of underlying hardware +having it's own memory regions (RAM and MMIO devices) and HARTs. The OpenSBI +will try to achieve secure isolation between domains using RISC-V platform +features such as PMP, ePMP, IOPMP, SiFive Shield, etc. + +Important entities which help implement OpenSBI domain support are: + +* **struct sbi_domain_memregion** - Representation of a domain memory region +* **struct sbi_hartmask** - Representation of domain HART set +* **struct sbi_domain** - Representation of a domain instance + +Each HART of a RISC-V platform must have an OpenSBI domain assigned to it. +The OpenSBI platform support is responsible for populating domains and +providing HART id to domain mapping. The OpenSBI domain support will by +default assign **the ROOT domain** to all HARTs of a RISC-V platform so +it is not mandatory for the OpenSBI platform support to populate domains. + +Domain Memory Region +-------------------- + +A domain memory region is represented by **struct sbi_domain_memregion** in +OpenSBI and has following details: + +* **order** - The size of a memory region is **2 ^ order** where **order** + must be **3 <= order <= __riscv_xlen** +* **base** - The base address of a memory region is **2 ^ order** + aligned start address +* **flags** - The flags of a memory region represent memory type (i.e. + RAM or MMIO) and allowed accesses (i.e. READ, WRITE, EXECUTE, etc) + +Domain Instance +--------------- + +A domain instance is represented by **struct sbi_domain** in OpenSBI and +has following details: + +* **index** - Logical index of this domain +* **name** - Name of this domain +* **assigned_harts** - HARTs assigned to this domain +* **possible_harts** - HARTs possible in this domain +* **regions** - Array of memory regions terminated by a memory region + with order zero +* **boot_hartid** - HART id of the HART booting this domain. The domain + boot HART will be started at boot-time if boot HART is a possible and + assigned for this domain. +* **next_addr** - Address of the next booting stage for this domain +* **next_arg1** - Arg1 (or 'a1' register) of the next booting stage for + this domain +* **next_mode** - Priviledge mode of the next booting stage for this + domain. This can be either S-mode or U-mode. +* **system_reset_allowed** - Is domain allowed to reset the system? + +The memory regions represented by **regions** in **struct sbi_domain** have +following additional constraints to align with RISC-V PMP requirements: + +* A memory region to protect OpenSBI firmware from S-mode and U-mode + should always be present +* For two overlapping memory regions, one should be sub-region of another +* Two overlapping memory regions should not be of same size +* Two overlapping memory regions cannot have same flags +* Memory access checks on overlapping address should prefer smallest + overlapping memory region flags. + +ROOT Domain +----------- + +**The ROOT domain** is the default OpenSBI domain which is assigned by +default to all HARTs of a RISC-V platform. The OpenSBI domain support +will hand-craft **the ROOT domain** very early at boot-time in the +following manner: + +* **index** - Logical index of the ROOT domain is always zero +* **name** - Name of the ROOT domain is "root" +* **assigned_harts** - At boot-time all valid HARTs of a RISC-V platform + are assigned the ROOT domain which changes later based on OpenSBI + platform support +* **possible_harts** - All valid HARTs of a RISC-V platform are possible + HARTs of the ROOT domain +* **regions** - Two memory regions available to the ROOT domain: + **A)** A memory region to protect OpenSBI firmware from S-mode and U-mode + **B)** A memory region of **order=__riscv_xlen** allowing S-mode and + U-mode access to full memory address space +* **boot_hartid** - Coldboot HART is the HART booting the ROOT domain +* **next_addr** - Next booting stage address in coldboot HART scratch + space is the next address for the ROOT domain +* **next_arg1** - Next booting stage arg1 in coldboot HART scratch space + is the next arg1 for the ROOT domain +* **next_mode** - Next booting stage mode in coldboot HART scratch space + is the next mode for the ROOT domain +* **system_reset_allowed** - The ROOT domain is allowed to reset the system + +Domain Effects +-------------- + +Few noteworthy effects of a system partitioned into domains are as follows: + +* At any point in time, a HART is running in exactly one OpenSBI domain context +* The SBI IPI and RFENCE calls from HART A are restricted to the HARTs in + domain assigned to HART A +* The SBI HSM calls which try to change/read state of HART B from HART A will + only work if both HART A and HART B are assigned same domain +* A HART running in S-mode or U-mode can only access memory based on the + memory regions of the domain assigned to the HART diff --git a/docs/doxygen.cfg b/docs/doxygen.cfg index dbf8ef9..82f31a7 100644 --- a/docs/doxygen.cfg +++ b/docs/doxygen.cfg @@ -795,6 +795,7 @@ INPUT = @@SRC_DIR@@/README.md \ @@SRC_DIR@@/docs/platform_guide.md \ @@SRC_DIR@@/docs/platform_requirements.md \ @@SRC_DIR@@/docs/library_usage.md \ + @@SRC_DIR@@/docs/domain_support.md \ @@SRC_DIR@@/docs/firmware \ @@SRC_DIR@@/docs/platform \ @@SRC_DIR@@/include \