From patchwork Mon Aug 8 16:27:48 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Hsia-Jun Li X-Patchwork-Id: 85277 Received: from vger.kernel.org ([23.128.96.18]) by www.linuxtv.org with esmtp (Exim 4.92) (envelope-from ) id 1oL5cH-009PPt-Rd; Mon, 08 Aug 2022 16:28:34 +0000 Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S243917AbiHHQ23 (ORCPT + 1 other); Mon, 8 Aug 2022 12:28:29 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:56434 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S237665AbiHHQ22 (ORCPT ); Mon, 8 Aug 2022 12:28:28 -0400 Received: from NAM10-BN7-obe.outbound.protection.outlook.com (mail-bn7nam10on2070.outbound.protection.outlook.com [40.107.92.70]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 5ADF426D9; Mon, 8 Aug 2022 09:28:27 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=RA1gmTxhG5A4ZCoX5Ids1yy1f9zYTadl1l3Uak6Xubl+rIWWj+cXrm/gPcxKg8W2r3ABLdE71J4c1GbZbR6f6T+5aHYd9vj1700wLIyjfcxSmogThJeNDkxhtZNh3186U513IbqxhV4Y75mdBhbN05ZdRMd0roKK1jkC8hn2GBssdyDtl3QGKK39HKZiS4wHwYk2M2dDIHiP8u2IsQKIfs1j4ZcKg4JCDYAdS8tnygh5End7W3TmRYaalCxj6yc9CngwRT4VoVbnUbnAJMAQXvl65/2x998Ro6/jPgsAEzlLJcAokEUp4NExsW3ZRvkb4AIZlw7dhv3+OAE61v5YNQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=2BqaHw7FXH7IftVfn9tw3S/F57TQQhKXkNKYEnKy2yw=; b=HUzchIoXO75lJg3ORrZTf0rbtu1/bWDDTrfPP3oXYv4db6eRtyp8W9VqvUanc51tjm/tsuFVclqcULihhRgpDfWJARnQiKWTv+NG/Bh413+fBEgGTQmNgph3ytwyJqAQEWFPGYes0l0b8dd2yXqQv/Be5De1spz43OYfn87kXyJSqKRyrA0iw8IiLxeohMNfm7aWoGnJZ7Okv3BaHfdzLhXkSmLJQlTNfrLNnBWCee6Aba0MX31wQ4O2hfjKNokrvLla5PjIGksizoDquRn6GNWh2nXANBDoK/3fKMQsuT1AvBEem89HBfaOt0PuWftAfcK6b3p0RlHgfFnwQkWVVQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=synaptics.com; dmarc=pass action=none header.from=synaptics.com; dkim=pass header.d=synaptics.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Synaptics.onmicrosoft.com; s=selector2-Synaptics-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=2BqaHw7FXH7IftVfn9tw3S/F57TQQhKXkNKYEnKy2yw=; b=oV+ikYVeDxRlklTVQ8i+bamCVsdmRP4/jthh9AgYLxbYEgeRPpv2GeCwFF09eSjs/8aSeVtrDnrK4AiFgg+9wb96lk4JX9PFoz9zInwMSi95kYAnJsKiWBrwjsBZPO4LtcPVpmCJ27A3Sum9qbf0DXf+KmI5+idaZ9UtBBdVDFE= Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=synaptics.com; Received: from DM6PR03MB5196.namprd03.prod.outlook.com (2603:10b6:5:24a::19) by BY5PR03MB5153.namprd03.prod.outlook.com (2603:10b6:a03:22c::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5504.15; Mon, 8 Aug 2022 16:28:24 +0000 Received: from DM6PR03MB5196.namprd03.prod.outlook.com ([fe80::c832:eea0:1883:a19c]) by DM6PR03MB5196.namprd03.prod.outlook.com ([fe80::c832:eea0:1883:a19c%3]) with mapi id 15.20.5504.020; Mon, 8 Aug 2022 16:28:24 +0000 From: Hsia-Jun Li To: dri-devel@lists.freedesktop.org Cc: maarten.lankhorst@linux.intel.com, mripard@kernel.org, tzimmermann@suse.de, airlied@linux.ie, daniel@ffwll.ch, mchehab@kernel.org, hverkuil-cisco@xs4all.nl, laurent.pinchart@ideasonboard.com, ezequiel@vanguardiasur.com.ar, sakari.ailus@linux.intel.com, ribalda@chromium.org, linux-media@vger.kernel.org, linux-kernel@vger.kernel.org, tfiga@chromium.org, sebastian.hesselbarth@gmail.com, jszhang@kernel.org, linux-arm-kernel@lists.infradead.org, "Hsia-Jun(Randy) Li" Subject: [PATCH 0/2] Add pixel formats used in Synatpics SoC Date: Tue, 9 Aug 2022 00:27:48 +0800 Message-Id: <20220808162750.828001-1-randy.li@synaptics.com> X-Mailer: git-send-email 2.37.1 X-ClientProxiedBy: BY3PR05CA0043.namprd05.prod.outlook.com (2603:10b6:a03:39b::18) To DM6PR03MB5196.namprd03.prod.outlook.com (2603:10b6:5:24a::19) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 309287c8-0c5f-45bb-d618-08da795b0390 X-MS-TrafficTypeDiagnostic: BY5PR03MB5153:EE_ X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: hWbPtkOb2X15ubjhEB5/XOEgh7NNvIHTWuGf0VH/V2a07Ao93bvR/o9VJ475oxQQTE5O3wSBN2p3aEfZ4jkDeXUUyO+6XbLGYXbvjVNu9TdnTGbZ/1HUudxeF7nY+p7YNPGEYf+RmWkulQA+NaAHgRMmKW6s0DbEBRU1J8oETaZenCm6gOsEZzlBRtUqtoz0kDQFr2cplZYPAkz4Rmj7+cEWgIQaUxyNg2C3mvicgBRIOuN7U34eWrBknJghpOEs2L32N8+pbyoB9lJ9dB9/sgOAP3EcY9HQ0dFeOokCOHUvyuhfvHvFzlF3wpZVByOLRw1k478gSof6UAaBvbWZxnOtn2jNDffQ9OOkSqF7cB1nATfzVR/cTj4Arv7Kdh8bfG7mPWtgchURQs/QqtcSV8DYhQOHeNO6uEeE6K3eTv38euJmQP0ecwtTa8oClALemNtlnH7gDVgv4mdxLykGgqbVcl6ZVO2tYMiZ5IHUyLtsWBIGHESf6PrShmiv7DJ7RIO4IrYcqya59rJX6l2NpjCe0vwSJLXNknPZOgvQec3jKS45Ze/+RanSn9fP/3D3PZ+6AaM42JwoX1joeP3tUD5J4ylCxP2B9zZS8Jv2YrQ55xygdad9EwSy5fCGICAlYz2wA16NHMx82q6BSgqNOMLYNykZqsoR8LJRaldTgKSH26R+HVN0UGFHFNbD76CxfQPJLcjkQ6+UfKmvDMtitDhFHHpMbq42ueXUzWNrJSw8Do2GavRwBXpWKTkYQGBL4+GFDsagHOM/2UvqAUSeT1pyjFobJZ3U/kBvTjBYzCbRXXHHKi9r9OrIdCdI8c8s5ArnJjwLp3zInkggHTIbng== X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DM6PR03MB5196.namprd03.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230016)(136003)(366004)(376002)(346002)(39850400004)(396003)(66556008)(36756003)(86362001)(6916009)(66946007)(66476007)(8676002)(4326008)(5660300002)(966005)(6486002)(8936002)(478600001)(316002)(38100700002)(107886003)(38350700002)(6666004)(41300700001)(6506007)(52116002)(2906002)(7416002)(1076003)(26005)(2616005)(83380400001)(6512007)(186003);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: d/i0NsJvckTbGcySGNlrk8vspNqUAKESoOLI/FlebW6Yq0w+e2j3GRgbXIL2Gvf/oYiSEK4mQaJwNs2eipCxTaL60BmHulIfslt4l6MQRIcysNLpopDoIeA7hn0h3sVlc8cLytZes4mRfId9qjh8Q/v+EQo2uhHao+k8LF/HXDQ6zk4ISLDnSfiISlne3KGFx77/YpBRR1trXA2EkFU2H/prYNpSooDWZEPCw/I7F+z343eQtIGGPby3OlLt5PaSxQ3woBnzY6ysk6SLqnRAMg4FUykfRGpLSsWuFr63tdrbhORItr9lQDocdZXEZq9Nky/UUxeySJxgtLbsFlaJSzOtCz2X0qUo2Kz7lV3OF4DBzbPRC9sk7tc6gEgXr4ler+1LMg2coQfjfZYDQx4n1+WeMQxgCru5vluWTxDO5PB8KXrBazP5WbiNe6KfaAE4NjZCAWPx9HoP2kbq/UJEf2n9eZl7+o+cDYtQmKkWVs9xg+la2aS1p8w7SRIPimRec01nrPmU4/9BEYlkrozkhYZKdFUaioKRclx9S/kGPDi5CBe6IQXd53ZWjQJcWD10KOEqZ9jpsLjP08s6uh8hUkrqX3NDwrvDiavS6PSg/sLuP8rl5iscbzOX48/EpT24IgLelX6rqUrL6Mpn38/tR5VRIbmp8OsFxyj+Ws2Sav36D42OSYHn4SGyBfAIGOHdmk8vFNuqrYcNz4zNmshChD+XEFzpaARC4qWjTuG19bdaqYAz3adw3+7+cUPnvrxGguf8B3mnNb+iOPpP4JDjpmPoXrXlcnknCgk3KadxMufEylmdZvfJCh0RpOcDhLnzzQLcZOnT5yWatnvWrqZZUst5IywfCUcyPqhKwaQAl8uXD2rviPH0P/Slrk7gGOAYYBRdK/FC8EWx/tT8XmBAKNBmCCDkIpmqAnNLocPENZmAU5fIQ/mmWgxFYma9bObVhNYISRS8EYpBB64vjx+r91sL+5o3VMJWVu1yWIi4RGQ29M7S0bXnP17sIWBoMklqt7mOuqsFMLCWTHEpC3+GpWMCgkdAYcq17f+10ytGG5UK7KAYU7htc5VSn1OKKSncOKtBafQyW7DvznXeEMwv0aF93bz5XiFFaYlRfcrrhZJFdF0TSRX4FQq8DhdoD8hVo9nl/T8O/2C+i29KJbFUk2TAFyj9CAnmybQJJl6cnnHcn57jMyncEfCea/dlrGwy3GgvuvsUes6AaNyKkztajwtRchg8ZEgo4HQ13Ibnk2xD6u0A2Kufv0DSs+ykIUKG5Xgs7hUDg4TXFnNw8MirRYnQLnm3V07tcmW79aZY9KA6NujkVPh3QV5Ns/ut+zGcGiUDDEsFIt+OHrXXbF6N7IuG60IsAWg9pB6L3lKfZhrPvB+hy6lbHjUU6/eL6d7bv7kp7PfLiuXKsbvduHZRt0ZRV6T6Ts1JZo+3uWtdu4P8juY1TUo6HiWZAVmH9Z91sr1+xc6e0vc4IIHWt3Fv324VlXo05rahYP242xl9eWNT58otAQM5M+gtzLnn10a02w1ZgTY+JKdpJAUxZaoAHMfwVG7WZb8gGJP/H2Dz/byqBwOFhzRT8Kou4zxwF4Nq X-OriginatorOrg: synaptics.com X-MS-Exchange-CrossTenant-Network-Message-Id: 309287c8-0c5f-45bb-d618-08da795b0390 X-MS-Exchange-CrossTenant-AuthSource: DM6PR03MB5196.namprd03.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 08 Aug 2022 16:28:23.9372 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 335d1fbc-2124-4173-9863-17e7051a2a0e X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: uf2WFyT+mGQXSits8kNLi3ZMJGUxyUS26jDSaQxitck8QZC1E145lSNWK9Xxe31WbN/VcSrRoJFGQkaexwPGDA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY5PR03MB5153 X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_PASS, T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-media@vger.kernel.org X-LSpam-Score: -2.4 (--) X-LSpam-Report: No, score=-2.4 required=5.0 tests=BAYES_00=-1.9,DKIMWL_WL_MED=0.001,DKIM_SIGNED=0.1,DKIM_VALID=-0.1,HEADER_FROM_DIFFERENT_DOMAINS=0.5,MAILING_LIST_MULTI=-1 autolearn=ham autolearn_force=no From: "Hsia-Jun(Randy) Li" Those pixel formats are used in Synaptics's VideoSmart series SoCs, likes VS640, VS680. I just disclose the pixel formats used in the video codecs and display pipeline this time. Actually any device with a MTR module could support those tiled and compressed pixel formats. The more detail about MTR module could be found in the first patch of this serial of mail. We may not be able to post any drivers here in a short time, the most of work in this platform is done in the Trusted Execution Environment and we didn't use the optee framework. Please notice that, the memory planes used for video codecs would be 5 when the compression is invoked while it would be 4 for display, the extra planes in the video codecs is for the decoding internally usage, it can't append the luma or chroma buffer as many other drivers do, because this buffer could be only accessed by the video codecs itself, it requests a different memory security attributes. Any other reason is described in the v4l pixel formats's patch. I don't know whether a different numbers of memory planes between drm and v4l2 is acceptable. I only posted the compression fourcc for the v4l2, because it is really hard to put the uncompression version of pixel formats under the fourcc. I would be better that we could have something likes format modifers in drm here. https://synaptics.com/products/multimedia-solutions Hsia-Jun(Randy) Li (2): drm/fourcc: Add Synaptics VideoSmart tiled modifiers [WIP]: media: Add Synaptics compressed tiled format drivers/media/v4l2-core/v4l2-common.c | 1 + drivers/media/v4l2-core/v4l2-ioctl.c | 2 ++ include/uapi/drm/drm_fourcc.h | 49 +++++++++++++++++++++++++++ include/uapi/linux/videodev2.h | 2 ++ 4 files changed, 54 insertions(+)