{"id":66,"date":"2026-03-26T17:16:30","date_gmt":"2026-03-26T17:16:30","guid":{"rendered":"https:\/\/opus-nemo.put.poznan.pl\/?p=66"},"modified":"2026-03-26T17:16:31","modified_gmt":"2026-03-26T17:16:31","slug":"pointy-a-lightweight-transformer-for-pointcloud-foundation-models","status":"publish","type":"post","link":"https:\/\/opus-nemo.put.poznan.pl\/?p=66","title":{"rendered":"Pointy \u2013 A Lightweight Transformer for PointCloud Foundation Models"},"content":{"rendered":"\n<p>We are happy to announce that our paper entitled &#8220;Pointy \u2013 A Lightweight Transformer for Point<br>Cloud Foundation Models&#8221; was presented during 22nd International Conference Advanced Concepts for Intelligent Vision Systems (ACIVS 2025).<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"267\" src=\"https:\/\/opus-nemo.put.poznan.pl\/wp-content\/uploads\/2026\/03\/image-1-1024x267.png\" alt=\"\" class=\"wp-image-67\" srcset=\"https:\/\/opus-nemo.put.poznan.pl\/wp-content\/uploads\/2026\/03\/image-1-1024x267.png 1024w, https:\/\/opus-nemo.put.poznan.pl\/wp-content\/uploads\/2026\/03\/image-1-300x78.png 300w, https:\/\/opus-nemo.put.poznan.pl\/wp-content\/uploads\/2026\/03\/image-1-768x200.png 768w, https:\/\/opus-nemo.put.poznan.pl\/wp-content\/uploads\/2026\/03\/image-1.png 1269w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>Foundation models for point cloud data have recently grown in capability, often leveraging extensive representation learning from language or vision. In this work, we take a more controlled approach by<br>introducing a lightweight transformer-based point cloud architecture. In contrast to the heavy reliance on cross-modal supervision, our model is trained only on 39k point clouds &#8211; yet it outperforms several larger foundation models trained on over 200k training samples. Interestingly, our method approaches state-of-the-art results from models that have seen over a million point clouds, images, and text samples, demonstrating the value of a carefully curated training setup and architecture. To ensure<br>rigorous evaluation, we conduct a comprehensive replication study that standardizes the training regime and benchmarks across multiple point cloud architectures. This unified experimental framework isolates the impact of architectural choices, allowing for transparent comparisons and<br>highlighting the benefits of our design and other tokenizer-free architectures. Our results show that simple backbones can deliver competitive results to more complex or data-rich strategies.<\/p>\n\n\n\n<p>[1] K. Szafer, M. Kraft, D. Belter, Pointy \u2013 A Lightweight Transformer for Point Cloud Foundation Models, Advanced Concepts for Intelligent Vision Systems: 22nd International Conference, ACIVS 2025, Tokyo, Japan, July 28\u201330, 2025, Proceedings \/ red. Jacques Blanc-Talon, Patrice Delmas, Hiroki Takahashi, Minami Yasuhiro \u2013 Cham, Switzerland : Springer, 2026 \u2013 p. 341-352, (CORE B)<\/p>\n","protected":false},"excerpt":{"rendered":"<p>We are happy to announce that our paper entitled &#8220;Pointy \u2013 A Lightweight Transformer for PointCloud Foundation Models&#8221; was presented during 22nd International Conference Advanced Concepts for Intelligent Vision Systems (ACIVS 2025). Foundation models for point cloud data have recently grown in capability, often leveraging extensive representation learning from language or vision. In this work, [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":{"0":"post-66","1":"post","2":"type-post","3":"status-publish","4":"format-standard","6":"category-uncategorized","7":"czr-hentry"},"_links":{"self":[{"href":"https:\/\/opus-nemo.put.poznan.pl\/index.php?rest_route=\/wp\/v2\/posts\/66","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/opus-nemo.put.poznan.pl\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/opus-nemo.put.poznan.pl\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/opus-nemo.put.poznan.pl\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/opus-nemo.put.poznan.pl\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=66"}],"version-history":[{"count":1,"href":"https:\/\/opus-nemo.put.poznan.pl\/index.php?rest_route=\/wp\/v2\/posts\/66\/revisions"}],"predecessor-version":[{"id":68,"href":"https:\/\/opus-nemo.put.poznan.pl\/index.php?rest_route=\/wp\/v2\/posts\/66\/revisions\/68"}],"wp:attachment":[{"href":"https:\/\/opus-nemo.put.poznan.pl\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=66"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/opus-nemo.put.poznan.pl\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=66"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/opus-nemo.put.poznan.pl\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=66"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}