Platform
- - Platform
    The UiPath Platform™ covers your automation needs across each step of the journey.
  - Products
    See what products we offer as part of the platform.
  - Pricing
  - Support
  - Free trials and downloads
- Platform
  The UiPath Platform™ covers your automation needs across each step of the journey.
  DISCOVER
  Identify the highest-ROI opportunities for continuous process optimization and automation using the power of AI.
  Process mining
  Task mining
  Communications mining
  Idea capture and management
  AUTOMATE
  Rapidly build AI-powered automation that seamlessly collaborates with people and systems to transform every facet of work.
  UI and API automation
  Low-code development
  Generative AI and experiences
  Intelligent document processing & specialized AI
  Process orchestration
  OPERATE
  Establish an enterprise-grade foundation to run and optimize a mission-critical automation program at high scale.
  Real-time and trend analytics
  Continuous testing
  Unified management and governance
  Cloud-first flexibility
  Discover the UiPath Platform™
  The future of the UiPath Platform is agentic and robotic
  Read the blog
  Products
  See what products we offer as part of the platform.
  FEATURED
  Some of our most popular products, and other products we think you would be interested in.
  Process Mining
  Test Manager
  Orchestrator
  Automation Cloud™ Robots
  Assistant
  DEVELOPER
  The developer’s toolbox for building AI-powered automations and apps across any technology.
  Studio
  Integration Service
  Apps
  Robots
  Computer Vision
  AI
  From specialized AI solutions to generative AI experiences—all in a single, enterprise-grade platform.
  Autopilot™
  Agent Builder
  Document Understanding
  Communications Mining
  Clipboard AI
  AI Center™
  See all our product offerings: All UiPath Products
  UiPath 2024.10: The path to agentic automation
  Dive into our most advanced platform ever and meet Autopilot™ for Everyone.
  Watch the replay
Solutions
- Webinars
  Learn best practices from industry experts.
  Customer stories
  Gather insight, read success stories, and more.
- By industry
  Banking & financial services
  Healthcare
  Insurance
  Public sector
  Manufacturing
  All industries
- By department
  Supply chain
  Finance & accounting
  HR
  QA / Testing
  Contact center
  All departments
- By technology
  Amazon Web Services (AWS)
  Google Cloud
  Microsoft
  SAP
  Technology solutions overview
- UiPath Joins Forces with SAP on an Integrated Offering to Accelerate Enterprise Automation for SAP Customers
  Read more
Resources
- dive in
  Academy
  Learn the skills of the future with free online automation training.
  Documentation
  Explore product documentation and guides.
  Events
  Get up close and personal with our people and products.
- Get Started
  What is RPA
  Agentic Automation
  Agentic AI
  AI and RPA
  Generative AI
  Specialized AI
  What is citizen development
  What is process mining
  SAP automation
  UiPath Blog
- Become an Expert
  Academy
  Academic Alliance
  Digital Credentials
  Certifications
  Customer Stories
  Events and webinars
  Demos and videos
  White papers
  Analyst reports
  See all resources
- Get Support
  Customer support
  Customer Portal
  Documentation
  Community
  Forum
  Marketplace
  Professional services
  Find a partner
- Automation done right. See how in our our Gallery of Customer Achievement.
  Learn more
About
- About us
  Learn about our company’s mission and vision.
  UiPath Partner Network
  Work with a partner to help your company reach new heights of automation.
- Company
  About us
  Careers
  Newsroom
  UiPath using UiPath
  Our Impact
  Investor Relations
  Trust & security
- Partners
  UiPath Partner Network
  Find a partner
  Become a partner
  Grow as a partner
  Business Partner Portal
  Technology Partner Portal
- AI breakthroughs. Groundbreaking research. Leading AI researchers.
  Visit UiPath.ai

All

uipath.com

Forum

Docs

Close

Try UiPath Free

UiPath Blog

Automation

Digital Transformation

AI

Industry Solutions

Product

RPA

More

Community Blog

Resource Center

Newsroom

Subscribe

Blog

Marius Cobzarenco

Marius Cobzarenco

Senior Director, Software Engineering - UiPath

Marius Cobzarenco, Senior Director, Software Engineering, UiPath

Latte latent attention for linear time Transformers

ai

October 1, 2024

Latte: Latent attention for linear time Transformers

Latte is a new linear time and memory replacement for standard attention, which achieves a comparable performance to Transformers while being more efficient during training and inference.

Get articles from automation experts in your inbox

Subscribe

Get articles from automation experts

In your inbox every Friday with links to our latest articles.

Subscribe

Get articles from automation experts in your inbox

Sign up today and we'll email you the newest articles every week.

Thank you for subscribing!

Thank you for subscribing! Each week, we'll send the best automation blog posts straight to your inbox.