Plain Transformers
No mentions found
This entity hasn't been tracked yet, or Iris is still building its knowledge base.
Related Articles from SNS
Plain Transformers are Surprisingly Powerful Link Predictors
arXiv:2602.01553v2 Announce Type: replace Abstract: Link prediction is a core challenge in graph machine learning, demanding models that capture rich and complex topological dependencies. While Graph Neural Networks (GNNs) are the standard solution, state-of-the-art pipelines often rely on explicit structural heuristics or memory-intensive node embeddings -- approaches that struggle to generalize or scale to massive graphs. Emerging Graph Transformers (GTs) offer a potential alternative but...
Vanilla ViT for Automotive Point Cloud Semantic Segmentation
Announce Type: new Abstract: Plain Transformers have become the de-facto architecture for processing text, audio, image, and video, offering a unified backbone for multimodal learning. However, state-of-the-art architectures for point cloud semantic segmentation remain dominated by U-Nets architectures where convolutions are interleaved with local or windowed attentions. In this work, we show how to effectively leverage vanilla, non-hierarchical ViTs for segmentation of large-scale...
Towards Consistent Video Geometry Estimation
arXiv:2605.30060v2 Announce Type: replace Abstract: This work presents ViGeo, a feed-forward foundation model for recovering spatially dense and temporally consistent geometry from video sequences. Built upon a plain transformer architecture without task-specific architectural modifications, ViGeo supports streaming, full-sequence, and long-video inference within a unified model. The key design is dynamic chunking attention, which exposes the model to both bidirectional and causal temporal...
Scalable GANs with Transformers
Announce Type: replace Abstract: Scalability has driven recent advances in generative modeling, yet its principles remain underexplored for adversarial learning. We investigate the scalability of Generative Adversarial Networks (GANs) through two design choices that have proven to be effective in other types of generative models: training in a compact Variational Autoencoder latent space and adopting purely transformer-based generators and discriminators. Training in latent space enables...
Show HN: A CSS 3D Engine (no WebGL)
A CSS polygon mesh library. A 3D engine for the DOM. Renders OBJ/MTL, GLB and VOX as real HTML elements transformed with CSS matrix3d(...) .
'PM was right to call out Nigel Farage's attempt to turn heartbreak into division'
'PM was right to call out Nigel Farage's attempt to turn heartbreak into division' 'Responsible leaders deal in facts, accountability and restraint - not turning public anger into political petrol' Refuelling the flames Nigel Farage insists he is merely asking difficult questions. Yet every time tensions rise, the Reform UK leader appears standing beside the petrol can with a box of matches in his hand. On Tuesday, he urged Britain to respond to Henry Nowak’s murder with “pure cold rage”.
A Robust and Explainable Transformer-Based Framework for Phishing Email Detection
arXiv:2511.12085v3 Announce Type: replace Abstract: Phishing and related cyber threats are becoming increasingly sophisticated, with email-based phishing remaining the most persistent attack vector. These attacks exploit human vulnerabilities to deliver malware or gain unauthorized access to sensitive information. Transformer-based models enhance phishing detection through robust contextual language understanding; yet they are often regarded as black boxes due to a lack of interpretability.
Port React Compiler to Rust
[compiler] Port React Compiler to Rust#36173 This is an experimental, work-in-progress port of React Compiler to Rust. Key points: - Work-in-progress - we are sharing early, prior to testing internally at Meta, to get feedback from partners in parallel with continued development.
Macsurf, "modern" web browser for macOS 9
The modern web, on a 25-year-old Mac. MacSurf is a web browser for Classic Mac OS 9 PowerPC. CSS3, ES5 JavaScript, PNGs with alpha, running on a G3 iMac.
Human-Like Neural Nets by Catapulting
Human-like Neural Nets by Catapulting Speculative proposal to create artificial neural nets with human-like performance by high-learning-rate/regularization training of overparameterized NNs to trigger catapulting/grokking. Over-parameterization as a route to true generalization would resolve many outstanding mysteries of artificial versus natural intelligence. There are many mysteries about deep learning and human intelligence, but we could describe the biggest anomaly this way: why are...