Momentum
No mentions found
This entity hasn't been tracked yet, or Iris is still building its knowledge base.
Related Articles from SNS
Denoise First, Orthogonalize Later: Understanding Momentum in Muon via Spectral Filtering
Announce Type: replace Abstract: Muon has recently demonstrated strong empirical performance in large language model training, but the theoretical role of momentum in Muon remains unclear. Existing analyses of Muon either remove momentum to study spectral updates in isolation, or retain momentum without explaining why it improves empirical performance. Our work bridges this gap by showing momentum in Muon acts as a spectral filter.
Denoise First, Orthogonalize Later: Understanding Momentum in Muon via Spectral Filtering
Announce Type: new Abstract: Muon has recently demonstrated strong empirical performance in large language model training, but the theoretical role of momentum in Muon remains unclear. Existing analyses of Muon either remove momentum to study spectral updates in isolation, or retain momentum without explaining why it improves empirical performance. Our work bridges this gap by showing momentum in Muon acts as a spectral filter.
Magnon momentum microscopy: A new window into nanoscale spin-wave physics
Magnon momentum microscopy: A new window into nanoscale spin-wave physics Sadie Harley Scientific Editor Robert Egan Associate Editor An international team led by the Max Born Institute has developed a new type of momentum microscopy to image magnons—the quanta of collectively excited spins—directly in two-dimensional reciprocal space using soft X-rays. Owing to its remarkable sensitivity, simplicity, and access to nanometer-scale wavelengths, this novel technique establishes a powerful and...
Solar Cruiser Disturbance Torque Estimation and Predictive Momentum Management
arXiv:2601.00532v3 Announce Type: replace Abstract: This paper presents a novel disturbance-torque-estimation-augmented model predictive control (MPC) framework to perform momentum management on NASA's Solar Cruiser solar sail mission. Solar Cruiser represents a critical step in the advancement of large-scale solar sail technology and includes the innovative use of an active mass translator (AMT) and reflectivity control devices (RCDs) as momentum management actuators. The coupled nature of...
Delayed Momentum Aggregation: Communication-efficient Byzantine-robust Federated Learning with Partial Participation
Announce Type: replace Abstract: Partial participation is essential for communication-efficient federated learning at scale, yet existing Byzantine-robust methods typically assume full client participation. In the partial participation setting, a majority of the sampled clients may be Byzantine, once Byzantine clients dominate, existing methods break down immediately. We introduce delayed momentum aggregation, a principle where the central server aggregates cached momentum from non-sampled...
Consecutive Support Matching Induced Parameter Tuning Accelerates Momentum Iterative Hard Thresholding
Announce Type: new Abstract: Momentum-based acceleration of iterative hard thresholding (IHT) can dramatically speed up sparse signal recovery from linear measurements, but its effectiveness hinges on careful parameter tuning -- a task complicated by the frequent support changes inherent to hard thresholding. We propose CosMIHT(Consecutive Support Matching Induced Momentum IHT), which resolves this difficulty through a simple adaptive rule: start with the conservative parameters and whenever...
The congruence of spacelike curves of tachyons with respective energy-momentum tensor of perfect fluid type
arXiv:2308.13527v2 Announce Type: replace Abstract: The Special Relativity allows the possibility of a class of particles, known tachyons, that have spacelike 4-velocities, i.e., which move with velocity greater than speed of light in vacuum. In this existence frame, the tachyons have energy and momentum and they must contribute to the gravitational field through by the means of the energy-momentum tensor. The superluminal perfect fluid tensor is obtained assuming the framework Lagrangian...
Josh Brown, counting on a new momentum strategy, thinks investors want more than index funds
Josh Brown, one of Wall Street's most recognizable financial advisers, said the rise of passive investing has created demand for a different kind of product: a concentrated portfolio aimed at capturing the market's biggest winners. The CEO of Ritholtz Wealth Management and CNBC contributor recently launched Porterhouse, a separately managed account named after the premium cut of steak and built to hold what he considers the market's best opportunities. The rules-based momentum strategy, run...
OptMuon: Closed-Loop Orthogonalized Momentum Methods for Stochastic Optimization with Zero-Noise Optimality
arXiv:2606.08783v1 Announce Type: cross Abstract: Orthogonalized momentum updates, as used in Muon-style optimizers, have recently shown strong empirical stability in large-scale deep learning. However, existing orthogonalized methods are typically paired with constant or open-loop magnitude rules, and therefore do not explicitly calibrate their update magnitudes from the observed optimization trajectory.
A Note on Stability for Orthogonalized Matrix Momentum with Client Sampling
Announce Type: new Abstract: We study finite-sample generalization for a client-sampled distributed optimization scheme with matrix-valued parameters and orthogonalized momentum updates. The central quantity is the gap between the population and empirical objectives at the returned model when only a subset of clients participates in each round. Under independent heterogeneous client data, unequal local sample counts, and fixed aggregation weights, we derive a finite-round upper-tail...