-
Latest Version
Lens Studio 5.3.0 LATEST
-
Review by
-
Operating System
macOS 10.13 High Sierra or later
-
User Rating
Click to vote -
Author / Product
Features and Highlights
Unparalleled Engagement
AR is core to the Snapchat experience. On average, over 75% of our community engages with augmented reality to communicate, play, and learn every day. With cross-platform distribution on iOS and Android, your creations can reach people all over the world.
Unlimited Customization
Realize any graphical style with visual programming tool Lens Studio for Mac. Create custom shaders with powerful Material Editor, or choose from the premade Materials Library.
Powerful Interactive Experiences
Start with the Behavior helper script to build interactive experiences without writing code, or use JavaScript to create more complex Lenses.
Transform Anything, Anywhere
With multiple tracking options and features like segmentation and Landmarker tracking, you can create whatever world you dream up.
Add Magic to Your Creations
SnapML allows you to make your Lenses even more intelligent with machine learning. Just plug in an ML model to apply any art style to the camera feed, use custom segmentation masks, attach images to custom detected objects, understand what’s in the scene, and more. Lens Studio is amazing software!
A Whole New Dimension
Seamlessly bring the physical and digital worlds closer together by applying your AR creations to Spectacles 3 content, so you can share your world—the way you see it.
Also Available: Download Lens Studio for Windows
What's new in this version:
Lens Studio 5.3.0
New:
- Native Caption Component lets you add a caption bar to your Lens that a Snapchatter can edit directly.
- Gaussian Splatting
- Upload video to generate 3D asset
- Object selection for extraction
- Animations
- Expanded animation library
- Upload custom animation files
- 3D Assets Generation
- Supporting .glb and .fbx formats
- Spatial Anchors API (Beta) (Spectacles)
- Persist content between Lens sessions.
- Fetch and Base64 APIs (Spectacles)
- Simplify web endpoint calls and camera frame exchange.
- Image Spatialization API (Spectacles)
- Convert 2D images to 3D using generative AI.
- Location API (Beta) (Spectacles)
- Access device GPS coordinates for location-based experiences.
- Web View Component (Spectacles)
- Embed web pages directly into your Lenses.
- New interactive sample scene (Spectacles Interaction Kit)
- Showcasing Spectacles Interaction Kit (SIK) capabilities
Improved:
- Interactive Preview
- Leaderboard Custom Component now is going to create a new leaderboard each Day/Week/Month/Year instead of having Score lifetime for each score individually. Also preview options and minor fixes were added.
- Connected Lenses DevEx Improvement in Preview
- In most cases(not based on “ConnectedLensEnteredEvent”), users don’t need to click “Join Connected Lenses Session” and “Reset” in each preview one by one, including opening a Connected Lenses Project, adding a Connected Lens Module and clicking “Randomize new Session ID”. SessionJoining will be ready automatically for all previews, including new opened previews.
- If Lenses is based on “ConnectedLensEnteredEvent”, clicking “Join Connected Lenses Session” is required to trigger this event.
- Introduced validation statuses indication in Project Settings
- Animations Plugin
- Search by animation description
- Body Morph Plugin, Head Morph Plugin V2, 3DAG Plugin V2, Face ML Effect Plugin V2, Immersive ML Effect Plugin V2
- UX/UI improvements
Fixed:
- Fixed issue with Spectacles Overlay Window size
- Fixed application crash during component pin and clearing fields selection
- Fixed application crash in cases when script is resetting without asset
- Fixed application crash in some cases of asset update
- Fixed application crash in case of old project updated with new version of application
- Fixed issue when script inputs were cleared in case of update script with incorrect data
- Fixed issue when application is showing incorrect name of blendshape
- Fixed issue with unpacked Leaderboard component
- Fixed application crash when user is trying to select Gaussian Splatting component
- Fixed application crash during ML Eraser component import
- Eye Color component has been fixed with Mode to allow to use texture or color
- Fixed tracking data for Face and Head mesh
Lens Studio 5.2.1
- Change log not available for this version
Lens Studio 5.2.0
New:
- 3D Upper Body Tracking and Mesh allows you to have a more precise tracking and meshing of the upper body, great for selfie use cases. It is tightly integrated, and can connect together with Face Mesh.
- Bitmoji Animation Example sample project showcases multiple uses of the Animation State Manager. It has simple, medium, and advanced examples, including to make a running Bitmoji game. Try making your own variation with the GenAI Suite, or modify the game completely!
- More additions to Sample Projects: Spatial Persistence, Optical Character Recognition, Music Video and Voice UI
- Remote Assets, and Assets Multi-selection has been migrated
Improved:
- Bitmoji API can be used along with Tappable Questions custom component
- You can now search on the Lens Studio’s Home screen
Fixed:
- issue when body mesh not visible in 3D Scene
- issue with published markers not tracking when using a compressed texture for the marker
- Added validation for marker texture size and scale
- issue with incorrect animated texture compression
- issue with 2D Editors when it needs to be reopened on project open
- issue with application crash when user switched to Inspect Preview mode
- issue with compressing ML assets
- issue with animated textures occasionally losing their compression settings
- issue with some projects not opening due to project cache and VFX
Lens Studio 5.1.1
- Fixed crash of pushed to device lenses on Snapchat Android 13.8
- Fixed issue when 2D Animation Texture From Files doesn't use correct order during generation process
- Performance improvement for assets which have been imported from new format on import and on deletion operations
- Performance improvements for projects with asset packages
- Performance improvements for installable content from Asset Library
- Fixed discrepancies with lens size in updated projects
Lens Studio 5.1.0
New:
- You can now apply to the Spectacles Developer Program directly through Lens Studio
- New features and capabilities for Spectacles (2024) development
- Spectacles specific Lens capabilities: Spectacles Interaction Kit, Perform Http Request, World Query Module, Gesture Module, Motion Controller Module, Camera Module [Experimental API].
- Spectacles Monitor panel which provides access to on-device temperature, power usage, and traces
- Spectacles starter project has been added to the home screen
- New Mobile Monitor panel which provides the ability to profile and view traces of your Lens on device–giving you insights into what’s happening behind your Lens Activation Time and FPS.
- New Project Settings: AI Lens Icon Generation, as well as a new window layout which provides a clearer look at your project, and validation for Lens submission.
New custom components:
- Dynamic Response: enables the sharing of data and Snap media between the Snap Poster and Responder
- Leaderboard (Available September 19): a real-time ranking component designed for games, which displays user scores and allows players to track their progress, enables users to compare their scores with friends and other players worldwide.
New in GenAI Suite:
- Body Morph: A tool for generating 3D full-body models that are tracked to the user’s body or 3D fully rigged characters based on a text prompt
- Bitmoji Animation Library: We’ve added hundreds of high-quality animations you can choose from and apply to Bitmoji, also seamlessly blend together multiple animations
- New additions to Sample Projects: Footwear Try On , Hair Simulation, Image Response, Connected Lenses, Image Response, Leaderboard (Available September 19)
- New / updated assets in the Asset Library: Foot Tracking Custom Component, Full Body Trigger Assets, Scan Assets, Hand Segmentation Assets, 2D Skeletal Asset and Sentiment Analyzer Asset, LSTween, Surface Detection, Spectacles Interaction Kit (SIK), improved default values on Flexbox Layout components, with updated docs and example projects.
- You can now tag a new project with “Trending Tags” featured on the home screen, so your Lens is opted in to Tags of the Month.
- License Audio support was added.
- Asset relinking support was added.
- 2D animation from frames support was added.
- Blend Node v2.0: easily composite transparent images in Material Editor with better handling of alpha channels and new controls for premultiplication and masking.
- Ability to animate Gaussian Splats.
Fixed:
- Fixed issue with poor performance in 2D editor scene
- Fixed issue with related to duplication of Custom Preview
- Fixed application crash in case of some custom plugin performed https request
- Improved compression of Gaussian Splatting asset
- Fixed some broken nodes in custom GS shader graph
- Fixed GS frustum culling issues in Scene Editor
- Fixed application crash when user is trying to use a None compression setting*
- Fixed issue with 3D Texture Noise asset
- Fixed application crash during search in Giphy panel
- Fixed application crash when user is trying to delete previously imported fbx model
- Fixed issue when video texture still playing after autoplay was disabled
- Fixed application crash after import of texture generated from Gen AI
- Fixed issue where VFX batching limit was not reduced when destroying VFX objects
- Fixed Interpolate node in VFX Editor
- Fixed scaling issue for VFX Custom Meshes with certain rotation values
- Fixed an issue with flipbooks in GPU Particles
- Fixed issue with Animation Player clips resetting
- Fixed issue with Text and Text3D’s “Capitalization Override”
- Renamed DepthTextureProvider’s getDepth to sampleDepthAtPoint to avoid conflict with TextureProvider’s getDepth()
- Added notification window if project is opened in a newer version
- Added missing wrap mode for 3D textures
- Now showing correct Envmap texture dimensions in inspector
- Fix crash for FBX files containing invalid path characters
- KNOWN ISSUES
- Script Graph is largely not functional. Graphs will not execute in the scene or in published lenses. Most nodes are not addable. See more in the Migration Guide
Lens Studio 5.0.19
New:
- New custom components: Camera Roll Widget
- New additions to sample projects: Segmentation trails, Landmarkers, Fullscreen, Meme Sticker, Camera Roll
- New / updated assets in the Asset Library: Segmentation assets such as Upper Garment Segmentation, Footwear Segmentation. Multiple landmarker assets. ML assets such as Face Mask Classification. Additionally, 12 new assets have been migrated from Lens Web Builder. These include 3D try-on assets for the user’s face as well as VFX assets. Update in Friends Carousel custom component. Fix in Animation State Manager component
- You can now tag a new project with “trending tags” featured on the home screen, so your Lens is opted in to Tags of the Month
Fixed:
- Fixed crash of Lens Studio application when application has issue with component picker
- Fixed crash of Lens Studio application related to JS asset deletion or update
- Fixed issue with incorrect logic for Pin-to-mesh component
- Fixed issue with texture input via JS
- Fixed crash of Lens Studio application once material assigned to Gaussian Splatting component
- Fixed issue with video textures rendering incorrectly in the preview panel
Lens Studio 5.0.17
New:
- Asset Preview has been updated with a lot more settings! You can now choose how you want to preview your asset.
- For textures, you can choose to view one of the RGBA channels or the mapping of the selected texture (planar, spherical, or environmental)
- View the UV mapping (checkerboard) on a selected geometry by pressing the button on the toolbar. You can also select the lighting for viewing the material/mesh: ambient, black light, directional light, and environmental light from selected presets.
- The material can be interactively adjusted on a selected primitive (box, sphere, 3D Snap ghost logo)
- You can also preview VFX assets and prefabs, zoom in/out, and interact with the 3D object by rotating it at any angle
- It is now possible to enable or disable the transparent background for all asset types
Garment Generation:
- Generate upper body garments including hoodies, pullover sweaters, t-shirts, dress suits, and bomber jackets with Garment Generation, new in Lens Studio’s GenAI Suite. Seamlessly, you'll have created a 3D try-on experience with a 2D garment that is already segmented and attached to the upper body.
- Asset Packages allows you to create and manage a package of assets in your library
- You can now access a component’s scene object by accessing the `sceneObject` property of a component in script
- Note: if you previously had `sceneObject` as a script input, an updater will automatically rename the property to avoid conflict
- New addition of sample projects: Tappable Question. We're bringing over the templates you loved from 4.55: Eyewear Try-On, True Size and Try-On template
- New custom components: Tappable Question Widget, Bitmoji Head, Friends Carousel, along with templates as assets like Footwear Segmentation are back in the Asset Library
- New / updated assets: Animation State Manager which resets trigger after consumption, and Bitmoji 3D Component which now supports shadows
Improved:
- Multi-select/box select for Animation Curve Editor
Fixed:
- Fixed crash from Start Screen
- Fixed issue when some Face Retouch setup can not be imported from old Lens Studio
- Fixed issue when app can crash on template open from Start Screen
- Fixed issue with Graph Editor Node Wires
- Fixed issue when app can crash during apply of changes on prefab
- Fixed issue with displaying generated 3D Assets and Head Morphs in the Scene View
Lens Studio 5.0.14
New:
- Introducing our GenAI Suite, including:
- ML Face Effect, Immersive ML, 3D Asset Generation, Head Morph, PBR Material, Texture and Face Mask Generation.
- An AI-Assistant for step-by-step AR development help.
- You can now create Plugins to extend the Editor! Check out existing Plugins in our Asset Library and find the API list here. We’ve also open sourced some plugins for you to reference.
- Figma Import Plugin – bring any Figma design directly into a Lens Studio scene.
- All community-created plugins and assets can now be submitted to the Asset Library through My Lenses.
- TypeScript support in addition to JavaScript
- New APIs including: Friends API, Bitmoji API, ChatGPT Remote API, Maps Component
- Support for Gaussian Splats
- General improvements to Raytracing:
- User Experience has been improved, no longer requires changing project settings
- Significantly improved loading time and decreased lens size impact
- Garment Transfer 2.0 supports more garments with higher quality like coats, hoodies and garments with necklines and run with significantly better performance.
- Real-time inspection lets you see the scene hierarchy change dynamically as the Lens runs for debugging and testing.
- New Animation Tools including Animation Player and Curve Editor.
- Try these new features with these new assets in the Asset Library: Curve to Material Helper Script which lets you use curves with materials and VFX, and Animation State Manager which allows you to blend between various animations, like Bitmoji 3D movements.
- Custom meshes can now be used with VFX
- We know you all love templates and color filters! We’ve now moved templates and color corrections into mix-and-matchable assets in the Asset Library!
The Big Little Things:
- New home page for project management! You can start a project for Snapchat, Camera Kit, or Spectacles with just 1 click.
- Improved version control-friendly project formats
- You can now see Tags of the Month within Lens Studio and My Lenses, which provide you inspiration on what to build next.
- Enhancements to our current Bitmoji capabilities within the Friends API. You can now use any pose from the Bitmoji Sticker Library.
- Multiple windows support
- Multiple device simulation
- History panel
- Pinnable inspector (and panels in general)
- Improved prefabs support. Users can now double click on prefabs to view them in the scene hierarchy and editor.
- Dynamic Asset Preview
- A new “Add New” button and organization of assets to help you get started more quickly!
- Project in-place auto-save
- ML models compression support
Improved:
- Inspector panel now supports component reordering by drag and drop. This helps provide easier control on ordering of script execution on a single scene object.
- VFX comes with several improvements under the hood, including batching which can significantly improve workflow and performance.
- Support of multiselect for Face Liquify
- Node and Subgraph improvements in VFX and Material Graph:
- New: Depth Distance Fade, Get Object Transform, Normalize to AABB, Polar Coordinates, Vertex ID
- Improved: Discard, new size mode (Normalize to AABB) for all VFX Size subgraphs, greatly improved noise calculations (Random Noise, Code Node system.getRandomFloat/Vec, and Particle Random)
- Cloth Simulation support
Fixed:
- Application switching no longer freezes Lens Studio
- Fixed Asset Library Report button
- Fixed issue when text blend mode does not allow non-black solid colors for transparent mode
- Fixed issue when compression setting were not saved for LSO,GLTF reimport
- Texture property for Text component has been fixed
- Fixed issue with VFX component on hardware with AMD GPU
Lens Studio 4.55.1
New:
- If you're experiencing consistent crashes while using Lens Studio, the Troubleshooting Lens Studio guide will help you address many issues and provide some recommendations for a more stable experience
Lens Studio 4.53
New:
- Lens Developers building City-Scale AR experiences will now be able to explore the area in an interactive environment in the Preview panel with the new Interactive Camera View.
- Through our partnership with OpenCV, Snap is providing a training notebook that allows you to train ML Models that support Optical Character Recognition.
- The Optical Character Recognition Template provides two parts to help Lens Developers get started with OCR; how to train a powerful OCR model, and a Lens Studio template.
- Lens Studio now offers the ability to utilize Pixels or Points, known as Device Independent Pixels, when adding a SceneObject to a Camera. When setting fields like size, padding, offsets or the various fields of the Layout Element, you can use the new device independent point unit instead of centimeters.
- The Meme Template offers Lens Developers an easy way to create movable screen sticker Lens by simply providing an image.
- The Quiz Template provides a convenient way to create quiz Lens by simply providing JSON data or directly editing the quiz in the Inspector panel.
- The Scene Manager Template demonstrates a few ways to use the Scene Manager Custom Component. Scene Manager allows you to break up your Lens into different pieces, reuse parts of Lenses, and improve overall Lens performance.
Improved:
- Major stability improvements, see the FIXED to learn more
- Support for ML Assets has been added to Remote Assets
- Multiple performance improvements to VFX Editor assets, especially for projects that have a lot of VFX in the scene
- Display Street Level Supported Area Info
- Spotlights now has a Falloff option
- PVR default for JPG in Lens Studio + template update
- True Size support to Eyewear Try-On Template
- Convert Graph GPU Particles to use instancing
- The Particles Template has been updated to use the new Instancing GPU Particles
Fixed:
- issue when Lens Studio application may crash during undo for parameters on materials/shaders
- issue when textures were duplicated on project reopen
- issue when Serializated prefab script order does not match unserialized prefab of script
- issue when video textures and other resources have been duplicated on project reopen
- issue when Lens Studio application can be crashed on project reopen when unsupported entities have been added into project folders accidentally
- issue with getPixels function
- Lens Studio application crash with mp4 resource
- issue when Lens Studio application creates unused folders as resource
- issue when user can not see city map in Map panel
- issue when Lens Studio application crashes when printing the destroyed collider component
- issue when Lens Studio application crashes with old projects structure during scene objects selection
- issue with Project Info menu items
- issue when projects created on macOS won't open on Windows OS
Lens Studio 4.49
New:
- The Lens Performance Toolkit enables Lens Developers to view performance statistics of their Lens by pairing with their mobile device
- The Masking Component helps to make sure content is visible only within a certain window of the screen. It helps create an invisible frame that hides content when that content moves outside of frame.
- The Face Stickers template allows you to quickly build a face sticker Lens. With this template, you can place any images or texts of your choice on positions relative to the face.
- The Necklace Try-On Template offers a quick way for you to get started with Necklace based AR Try-On Lens experiences
- With the Eyewear Try-On Template, Lens Developers can create unique glasses AR Try-On experiences at professional level. The Eyewear Try-On Template offers a quick way for you to get started with Glasses based Try-On experiences.
- The ML Retouch features offers Lens Developers a way to switch this feature on for beauty Lenses, or any Lens that involves the front-facing camera, to naturally enhance a Snapchatter’s face while keeping unique facial features like freckles, beauty marks and more.
- The "What 'X' Are You?" Template allows you to build your own unique spinner Lens by simply providing a list of words, images, colors, or a combination of them
- Lens Studio now supports Machine Learning models from Roboflow
- Lens Studio’s scripting runtime has transition to utilize Javascript ES6
Improved:
- Face Tracking effects working will now perform more optimally when used together with the Garment Transfer custom component
- Footwear Try-On has been updated to a SnapML model that better detects the user’s foot and provides a better quality try-on experience
- The Earring Try-On Template has been updated to showcase additional features to enhance the user experience
- Raytracing has been updated to improve performance out of the box
- Lens Studio Project Information has been updated to declare if a Lens will be a Camera Kit Lens directly within Lens Studio
- City-Scale AR Template has been updated to showcase more in-depth information about how City-Scale AR Content works
- The Wristwear Try-On Template has been updated to utilize a new wrist occluder asset that is customizable to fit your Lens Experience
Fixed:
- Fixed issue with vertex color on latest Nvidia drivers
- Fixed issue with shaders/materials on latest Nvidia drivers
- Fixed issue when remote assets rendered without textures
- Fixed Tween Manager example
- Fixed issue when LS crashed when trying to attach VSCode debugger
Lens Studio 4.46
New:
- The Masking Component helps to make sure content is visible only within a certain window of the screen. It helps create an invisible frame that hides content when that content moves outside of frame
- Hand and Nails Normals Maps allows developers to precisely add art to a user’s individual nails with a new subset of the Hand Segmentation Mask
- Nail Segmentation is now out of beta and ready for public use
Improved:
- The Garment Transfer Custom Component has been updated to include better quality rendering and support for a broader variety of textures and colors. This also includes the ability to create garments that feature animated content, the ability to provide a custom segmentation mask for garments and better target tracking.
- New Workflows and interactions has been included to make working with Location AR content easier in the Interactive Environment.
- Update Uber PBR material with code node
- `Duplicate` selected button added for Animation Layer
- Range Type updated with `Frames` by default
- Improves behavior for custom component development to show unknown type widget for user via Logger with error and line number
Fixed:
- with Lens Studio freeze when Lens Studio is trying to compile TS files
- when Lens Studio application can crash during HDR texture import
- when project can not be open after resource corruption
- when project can be corrupted after prefab import with custom component
- when @type name inputs were cleared after resource import-export
- when project can be corrupted when saved in cloud services
- when specific prefab can freeze Lens Studio application
- when project can be corrupted after import of specific prefabs which has VFX resource
- when second mobile device which was paired with Lens Studio will not receive notification in Snapchat app after lens push
- when user can received notification that shader needs to be updated for VFX asset
- when Render Order was forced to AUTO for instantiated prefab
- when user can not open project after fbx model was imported into it
Lens Studio 4.43
New:
- Cubemaps offers Lens Developers the ability to apply multiple 2D Textures to an individual face of a cube to be used to generate effects such as skyboxes, reflections and unique lighting setups
- The Cubemap Template showcases various ways Lens Developers can use cubemaps to create lightweight and complex lighting solutions
- SnapML’s new Portrait Relighting introduces the ability to enhance or change the light and background of photos, as well as adding your own custom lighting to photos
- The Gem Rendering Custom Component provides Lens Developers a way to reproduce the unique lighting effects in gemstones such as ruby, sapphires and diamonds
- The Gem Rendering Template offers Lens Developers a quick way to get started with building Gemstone focused Lenses
- The Physics Lab template in conjunction with the Content Editor Tools, teaches both Lens Developers and Snapchatters how to both author and play a simple physics-based game on device and from within Lens Studio
- Lens Studio Visual Studio Code Extension has been released to the VSCode Marketplace to help streamline Lens Studio development in VSCode
Improved:
- Lens Developers can now opt-out of using the Version Control Friendly Project Format
- Support for Multiple Custom Locations in a single Lens
Fixed:
- Fixed crash of Lens Studio application when update materials dialog applied for Responsive Plants template
- Fixed issue when user received update materials button after project reopen instead of on state when assets were added into project
- Fixed issue when project can not be reopened on macOS after custom components was deleted from the project
- Fixed crash of Lens Studio application when project with VFX assets was optimized
- Fixed crash of Lens Studio application when import of ML model was canceled
- Fixed issue when user received unexpected user dialog in Lens Studio Tutorial
- Fixed issue when animated WebP asset imported as upside down
- Fixed issue when ‘getTimeLeft’ for delayed events returning elapsed time, not remaining time
- Fixed issue when Lens Studio application will not revert updated shaders to old version after Undo
- Fixed crash of Lens Studio application if script invalidates a physics body
- Fixed issue on Windows OS when user can not reopen project which was saved in folder connected with Google Drive
- Fixed issue when Connected lens template shows error level log if not hitting the join button
Lens Studio 4.40.1
Improved:
- Optimized load time when opening a new project
Fixed:
- a crash affecting opening the City-Scale AR template
- issue where changes to the node editor would not be saved as they’d get reverted on project-open
- issue where submitting lenses with with special characters in the name resulted in them getting trimmed
- a crash caused by duplicating segmentation texture resources
Lens Studio 4.40.0
New:
- RayTracing in Lens Studio is a rendering technique to produce incredibly realistic looking images by simulating the way light behaves in the real world. With Lens Studio 4.40, the first set of Ray Tracing features include Real Time Reflections and RT Materials
- While all features go through foundational testing and QA before release, it’s possible that certain technologies can impact delivery and performance of your Lens. Those first to leverage new capabilities take on the risk of unproven technologies in order to drive innovation and testing. For Sponsored Lenses in particular, make sure to follow our best practices for optimal File Size, Frames per Second (FPS), and other optimizations that are critical for success.
- The Ray Traced Reflections Template showcases how to get started with creating Ray Traced Reflections within Lens Studio.
- Lens Studio 4.40 now offers a new Version Control Friendly Project format to help you streamline collaboration on projects, especially when you’re working in teams
- Multiple templates have been updated to reflect the new Version Control Friendly Project format
- The Facial Features Segmentation Custom Component provides multiple segmentation options for creating different Face AR and Try-On experiences by utilizing different facial landmarks
- Lens Studio now offers an offline mode when no internet connection is available
- Sync Framework has been updated to address issues and includes a new template to showcase how Sync Framework simplifies creating Connected Lenses
- The Voting Template shows you how to use Sync Framework to build an AR experience that allows multiple users to contribute their input for selection in a shared session
- The Gravity Gun Template, created by MousePack, offers Lens Developers a unique way to integrate your own physics-based tools within your Lens
- [Beta] Nails Segmentation and Tracking enables Lens Developers to build unique Nail Try-On experiences.- Multiple Hand Segmentation Masks are now supported
- Lens Studio for Unity Developers is a new guide dedicated to helping Lens Developers bring their knowledge and experience from Unity to Lens Studio to build augmented reality experiences
- The Performance and Optimization for Lenses guide provides more information on how best to optimize your Sponsored and Non-Sponsored Lenses and for a wide range of devices
- The Asset Library has been updated to include the following features
- The Asset Library is now treated as a panel within Lens Studio
- New asset type “UI Hints” that encompasses new assets for Lenses
- New Places API available in Asset Library
- The Lens Analytics guide has been updated to inform Lens Developers about Event Insights and Community Audience, providing ways to learn more about how Snapchatters interact with your Len
- The My Lenses portal has been updated to include Lens Submission Error Reporting to learn more about how to track any errors that may affect your Lens Submission
- Render Target Scaling allows a Lens Developer to select their desired resolution scale from the UI, instead of having to code your own implementation
Improved:
- Lens Studio Start Screen has been redesigned to create a better first time user experience
- Lens Studio now Supports Lens and template names with special characters
- Optional Parameters in Remote API Codegen are now supported
- Print logs from pushed lens running on mobile
- Spot lights are now supported in Lens Studio
- List of Devices in the Device simulation has been updated
- TouchBlocking support for InteractiveComponent
- Texture compression improvements
- Support for Multiple Custom Locations in a single Lens
- Face Mesh Reference has been updated to include 3D representation for Ears
Fixed:
- Video recorded on mobile device has wrong aspect ratio
- Fixed issues where materials would not render when pushed to devices
- Fixed issue where the application would crash after the Scene Object under Prefab was duplicated and the change was applied
- Fixed issue where the application would crash when trying to download remote assets via APIs
- Fixed minor text alignment issue in Arabic
- Fixed an issue where changing the blend mode for the last added image element caused all others with the same material to become translucent as they use the same darkened blend mode
- Fixed issue when new layers are not automatically assigned to Light sources if previously layers were deleted
- Fixed issue when Lens Studio crashed on import of HDR textures
- Fixed issue when not used VFX resources were not deleted after optimization
- Fixed issue when ‘Light Balancing’ custom component does not work with other custom components
Lens Studio 4.36.1
New:
- With LensFest 2022, The Snap AR Engineering team has created two new developer focused tools to help accelerate and streamline Lens Development
- Sync Framework is a set of scripts and components designed to help you build Connected Lenses for building shared online multiplayer experiences.
- The Persistent Noteboard template features a note-taking Lens that utilizes the Canvas component and comprises two note-containers and an Input Modal for creating note entries
- The Lens Quality Assurance Troubleshooting guide offers a series of tasks and examples of common bugs you may encounter when building Lenses and how best to resolve those issues
Improved:
- New option in 2D scene toolbar to make ScreenTransforms save their screen space coordinates when being reparented
- As previously mentioned in our Community Forum post, New Lens submissions using Wannaby Technology will be rejected in Lens Studio.
- Please note that existing Lenses using Wannaby Technology will continue to run in perpetuity, however they can no longer be updated
- Best Practices for Remote Assets has been added as a way to help create a fluid user experience when building Lenses with Remote Assets
- Update of autogenerated code to print error code and messages when API requests fail
Fixed:
- bug hiding autocomplete results in script editor
- crash of Lens Studio on specific prefab Apply after it was instantiated
- issue with 'Divide' node for specific mobile and desktop devices
- issue when Custom Component file (.lsc) is showing as modified right after project reopen
- issue when Custom Component typename input can disappear after project reopen
- issue when Lens Studio can not be launched on macOS Ventura
Lens Studio 4.36
New:
- With LensFest 2022, The Snap AR Engineering team has created two new developer focused tools to help accelerate and streamline Lens Development
- Sync Framework is a set of scripts and components designed to help you build Connected Lenses for building shared online multiplayer experiences
- The Persistent Noteboard template features a note-taking Lens that utilizes the Canvas component and comprises two note-containers and an Input Modal for creating note entries
- The Lens Quality Assurance Troubleshooting guide offers a series of tasks and examples of common bugs you may encounter when building Lenses and how best to resolve those issues
Improved:
- New option in 2D scene toolbar to make ScreenTransforms save their screen space coordinates when being reparented
- As previously mentioned in our Community Forum post, New Lens submissions using Wannaby Technology will be rejected in Lens Studio.
- Please note that existing Lenses using Wannaby Technology will continue to run in perpetuity, however they can no longer be updated
- Best Practices for Remote Assets has been added as a way to help create a fluid user experience when building Lenses with Remote Assets
- Update of autogenerated code to print error code and messages when API requests fail
Fixed:
- bug hiding autocomplete results in script editor
- crash of Lens Studio on specific prefab Apply after it was instantiated
- issue with 'Divide' node for Android and Apple Silicon
- issue when Custom Component file (.lsc) is showing as modified right after project reopen
- issue when Custom Component typename input can disappear after project reopen
Lens Studio 4.31
New:
- Remote Assets offers developers a way to store assets within Lens Cloud to dynamically load their created content into Lenses at runtime. Since Remote Assets do not count against the Lens size limit, developers can build more complex Lenses and re-use assets across multiple Lenses.
- With this release of Remote Assets, developers can utilize assets up to 10MB per asset and a max of 25MB per Lens. Organizations can use up to 500 MB of space for storing assets.
- The Physics System has been updated to enable Developers to create Lenses with more realistic interactions and movement between AR objects in a scene. Some of the major features include;
- Support for Collision meshes, allowing collision, simulation, and ray casts against arbitrary render meshes
- Correct handling of center-of-mass and inertia
- Extend ray cast functions to support sweeping a primitive shape, such as a sphere, along a transform path.
- Support for collision filtering, enabling control over how colliders interact with one another
- With the addition of Los Angeles and Santa Monica as new cities available in Lens Studio, creators can now build City-Scale AR content spanning across the multiple cities mapped in Lens Studio.
- The City Landmarker feature has been renamed to City-Scale AR
- Canvas is a new Component that creates a dedicated root within the ScreenTransform hierarchy to dynamically place 2D Components, like Text and Image, in 3D space. The Canvas Component is built to adapt to multiple tracking solutions, giving Developers the flexibility to add more 2D AR enabled content to their experiences.
- Tooltips have been added to Lens Studio as a quick way to get information about how to use Lens Studio
Improved:
- The new Hand Tracking solution has been added to Body Tracking
- The ‘Sounds’ section in the Asset Library has been renamed to Music to provide Lens Creators an easier way to add their favorite songs to Lenses
- The glTF material and glTF Importer has been updated to support two new extensions: `KHR_materials_sheen` and `KHR_texture_transform`.
- Lens Studio Templates will now display the name of the Creator on the homepage
- Added a dedicated Asset Library button in the Add Resources panel
Fixed:
- issue of broken Custom Code Node validation
- issue when default envmap textures were deleted during component deletion
- issue when studio may crash after copy a physics collider component
- issue when Audio Component stops working once joined Connected Lenses session
Lens Studio 4.28.1
Fixed:
- Live Tracking now shows 3d model from the project instead of default
- JS Docs have been updated update
- Face Occlusion template no longer opens with errors
Lens Studio 4.28.0
New:
- With Spatial Persistence, Snapchatters will be able to read or write AR content at a physical location and retrieve this data at the same physical location when they restart their lens.
- The new Spatial Persistence Template shows how Lens Creators can build AR content that is tied to a physical location in the world
- Along with Spatial Persistence, The Content Editor Tools asset provides a set of plug-and-play custom components that enable users to place and manipulate persistent AR content.
- The new Content Editor Tools Template showcases how to build persistent AR content where users can place and manipulate AR persistent content inside a Lens.
- Voice ML’s Question Answering Service gives Lens Creators the ability to build voice enabled Lenses that can understand questions about a single topic and receive real time answers based on pre-loaded informational text.
- A new hand tracking solution has been implemented that now enables Two Hand Tracking within Lenses. This update expands upon the current 3D Hand Tracking solution to efficiently track two hands at once when building content for Spectacles.
- Lens Creators can now use the new Face Occlusion custom component that can be used to improve Face enabled Lenses by masking out content that is covered by hair, hands or other objects.
Improved:
- The Speech Recognition Template has been updated to showcase support for French
- The Bitmoji Custom Component has been updated to include the new hand tracking solution, allowing for Snapchatters to attach their Bitmoji avatars to bodies in Lenses and enable hand tracking
- Support for Arrays of Combo Boxes and Quaternions have been added to the Script Editor
- Render Layer Controls now visible in the Inspector for all SceneObjects
- Added submission warning box for Lens submissions with one camera turned off, to help creators get maximum reach on Snapchat
- Added object preset for empty ScreenTransform
Fixed:
- issue when Auto-updater is stuck on restart if permissions to the app folder are not granted to the effective user
- issue when parameters before the light loop node are not displayed in the material inspector
- issue when Interactive Preview movement keys conflict with the common shortcuts
- issue when Live tracking UI missing if you close Preview panel or open other project
- issue with when renaming with pressing Enter can't be finished with pressing Enter second time
- issue when script graphs cannot be exported
- issue when @typename field doesn't refresh inspecto
Lens Studio 4.25.1
Fixed:
- issue with My Lenses re-login after Lens Studio launch
- issue when VFX blend mode not applied right away
Improvements:
- Update for upper garment segmentation model
Lens Studio 4.25.0
New:
- Similar to Hand Segmentation, Footwear Segmentation allows Lens Creators to segment effects within or around a user’s feet. In our Footwear Segmentation template, you will learn how to utilize the new segmentation feature to render unique effects.
- The Body Morph template enables Lens Creators to morph the body of a user into another custom mesh which has the same UV map as the standard Body Mesh
- Lens Studio scripting now supports Script Modules in the Common JS format. By adopting this industry standard, and providing support for it in lenses, we are enabling professional JS development.
- There is now a dedicated Script Modules category in the Asset Library
- Support for .glTF Physically Based Rendering extensions have been added, including transmission, clear coat and unlit extensions
Improved:
Custom Components have received the following improvements:
- Creating ScreenTransforms at runtime will now have the same default values as creating them in Lens Studio
- Creating Visuals like Text or Image at runtime will now have automatic render order like creating them in Lens Studio
- Added ability to view and edit common parameters in inspector for multiple selected resources of different types
- We have updated our ASL Template with new animations, models and logic
Fixed:
- issue when VFX material can not be compiled after import from lso
- issue with colocated landmarks materials in Connected Template
- issue with render when Face Inset was duplicated
- Lens Studio crash when occluder material was re-added
- issue with Uber PBR material if Blend Mode was updated
- issue when overlay does not work because of Blend Mode from Post Effect
Lens Studio 4.22.1
Improved:
- Fixed issue with graph material blendmode
- Fixed issue with node disconnect in graph material
- Fixed issue when colored material looks flat white
Lens Studio 4.22.0
New:
- With the new 3D Bitmoji integration into Lens Studio, developers will be able to create new innovative ways to bring the power of expression to their avatars. Starting with 4.22, users will be able to drive 3D Bitmoji with Body Tracking.
- Please visit the Bitmoji Template to see how you can get started adding Bitmoji content to your creations
- The Code Node is an advanced feature that enables developers the ability to create custom shader code directly in the Material Editor and VFX Editor, unlocking new effects and performance enhancements
- A Code Node Template has been provided to showcase some beginner, intermediate and advanced shader content that is now possible in Lens Studio
- Included with this release is a dedicated Code Node Reference guide covering the syntax used by the Code Node feature
- Shadertoy to Lens Studio is a new guide aiming to help developers migrate their shaders and materials over to Lens Studio
- Voice MLnow provides an Automatic Voice Style Selector that allows developers to automatically detect emotions from text. With this feature, developers can create a voice that corresponds to one of five emotional categorizations.
Improvements:
- New assets have been included in the Asset Library to enable developers to quickly add Connected Lenses, Persistent Storage, New Face Styles and Utility functions to your creations.
- Applying prefabs sometimes caused unnecessary reordering & re-selection of prefab root's immediate children, which created confusion, and has been addressed
- Added ability to change compression settings for several objects
- Updated the project optimization settings to remove unused render layers and lights
- Adjusted how a new face effect is attached to a camera in the scene
- Added a way to Sync the editor scene view with direction with map location icon for City Landmarkers
- Improve the navigation of city scale landmarkers in Lens Studio
- Allowing developers to adjust the camera speed in editor scene and interactive preview
- You can now test shopping Lenses on push to device
Fixed:
- Fixed crash of Lens Studio on Import of different glb and glTF files with embedded texture
- Fixed crash of Lens Studio on update of some custom components
- Fixed Screen Transform position settings
- Fixed skeletal detection in preview scene
Lens Studio 4.19.0
New:
- Lens Cloud is a collection of backend services, built on the same infrastructure that powers Snapchat. Lens Cloud vastly expands what developers can build in augmented reality by providing Multi-User Services, Location Services, Storage Services and Scanning Services.
- With the release of Lens Cloud, a City Scale Template has been provided to learn how to get started building city wide content for London, UK.
- A dedicated Visual Studio Code Extension has been released to give developers the functionality to use VSCode as an IDE for their Lens Studio projects. With the extension installed, VSCode enables; Code editing and smart code completion, JavaScript debugging for Lenses and JavaScript code snippets for Lens development.
- Body Depth & Normal Texture Guide and Template provides developers a detailed estimate of the depth and normal direction for every pixel of a person including their body, head, hair, and clothes. This lets the user easily create sophisticated lighting effects and calculate realistic occlusion and collisions with AR objects.
- Depth Render Target gives developers the ability to capture a Camera's depth stencil texture, enabling ways to create custom effects such as screen space normals, custom occlusions, fog, and depth-based particle collisions.
- SnapML has also received some updated features to enhance a user’s experience and understand the user’s environment
- Light Estimation allows developers to do more realistic rendering by matching the real world lighting on objects rendered by the Lens
- Noise/Blur Estimation gives developers the ability to match the noise and blur levels from the device’s camera with the AR content
- SnapML now supports quantized models, an ML model format. Some of the benefits include; model size reduction by 50%, fast inference speed, and more power efficiency.
- To help showcase quantized models, a new Multi Class Classification Template has been added to showcase these new features
- Lower Garment Segmentation has been added to the Segmentation System allowing developers to get segmentation masks based on data for upper-garment and lower-garment systems simultaneously with low overhead. A Segmentation Trails Template has been added to showcase this functionality.
- True Size Object Template is a new template that utilizes the best tracking solution available for your device to provide users an accurate scale when placing objects in their physical space. This allows users to test how well physical objects can fit into their environment.
- Voice ML has received two new templates for developers to learn how to add an extra layer of personalization to their content
- 2D Animated Text-to-Speech uses a user’s voice to animate 2D lips to be synced with voice
- Sentiment Analyzer is a new ML model that returns one of 28 optional emotion classes, such as hope, happiness and anticipation
Improvements:
- The API Library has expanded allowing you to now build Lenses with third party APIs that give play by play data from five different sport leagues, daily zodiac astrological predictions, and location specific air quality data.
- Additionally, we made it easier to build Lenses with third party APIs by automatically generating a block of code used to connect to an API upon importing the API asset into your project.
Fixed:
- issue when duplicate custom components cannot be created from script
- issue when base color textures are tinted blue on import of certain glTF files
- crash of Lens Studio with different glTF models
- crash of Lens Studio when specific script has errors
- issue when 'Device Camera Texture' moved from folder into root of Resources Panel
Lens Studio 4.16.1
New:
- Custom Landmarkers enables Lens Creators to create their own location based AR Lenses. With this update to the Landmarker feature, Creators can utilize the new Custom Landmarker Creator lens on their LIDAR-enabled phone to scan and upload their own Landmarkers for use within Lens Studio.
- With the new Custom Components category in the Asset Library, Creators can now use script components bundled with resources that can be installed easily and added to Lens Studio projects. To celebrate the release of Custom Components, various Face Effects have been released as a Custom Component to let Lens Creator quickly utilize and implement unique face filters powered by SnapML. Popular filters such as baby, bald, anime, 3D animated and poster are now available as a custom component. Try adding them in your own project, or by checking out the Custom Components template
- Audio Classification is a new Voice ML Template that allows Lens Creators to enable Lenses the ability to listen and categorize sounds into several categories;
- Human Sounds
- Animal Sounds
- Music Sounds
- Natural Sounds
- Other Sounds (Such as - Street Cars, Work Tools)
- With the new Spectacles Voice Control template, Lens Creators can learn how to incorporate transcription and keyword detection to their wearable experience.
- Native Keyboard support has been introduced as a way to allow Lens users the ability to edit Text and Text3D components in real-time within a Lens.
- The Physics system has been updated to better support smaller objects, fast moving objects, and objects that vibrate in place. As a part of this update, Physics Matters allow for Lens Creator to adjust the bounciness, and friction settings of a given object.To help demostrate some of these features, a Physics Toybox template has been included with 4.16.
- Snap is introducing Draco Compression integration into Lens Studio to allow Lens Creators to streamline their process when working with high-poly count and photogrammetry created 3D assets.
- Auto-Updater in Lens Studio enables users to download and install the latest version from within the application. Along with this, the feature also provides the ability to open older projects in their respective Studio builds, without the need to bump the minimum client versions for the project.
Improved:
- Documentation for Plume Labs by AccuWeather APIs endpoints has been added
- Various VoiceML Enhancements have been added in 4.16
- Speech Recognition template now supports Spanish and German
- Voice UI Template now includes 2 new voice commands: “Save to Favorites” ; “Send Lens to Friends”
- In order to help streamline authentication across multiple platforms, Creators will now be able to log in via their Snapchat account when using Lens Studio
- Physics - Static colliders can now be nested without being merged into compound shapes. This makes it so child colliders can be moved and deformed kinematically.
Fixed:
- Fixed a bug that may prevent Lens Studio from starting up
- Addressed an issue that would cause Lens Studio to crash when closing a project
- Fixed an issue with ScriptComponents that would potentially prevent projects from opening.
- Fixed issue with VFX assets disappearing
- Fixed compiler errors on VFX Collision template
- Fixed problem with saving project after importing resource
Lens Studio 4.13
New:
- Installable Content enables dynamic delivery of different types of content, such as templates, presets, etc. that are independent from Lens Studio versions
- Audio Output template generates sounds with JavaScript and plays them on device. It provides simple examples such as oscillators, noise generators, audio track file players, etc
- Downloadable Shopping Template to create Lenses connected to the Product Catalog for Snapchat Business Accounts
Improved:
- Cloth Simulation that was only available through Javascript, now has UI enabled
- Foot tracking template that allows you to attach objects to your feet has been updated, and is now available in Lens Studio
Fixed:
- error if authentication scope was incorrect
- crash on Mac with Apple Silicon CPU when trying to import HDR with high quality
- issues with Lens Studio locking up on Windows when two or more videos textures were running
- issue with GIF relink on losing connection to original file
Lens Studio 4.10
New:
- Sounds - Integration of a sound library in Lens Studio that enables discovery and import of licensed music tracks in Lenses. See an example in the Music Video template.
- Physics - Physics in Lens Studio enables you to dynamically simulate real-world physics effects in your projects. Objects in the scene can now behave and interact with forces such as gravity, velocity, acceleration, and more. See it in action in the Physics template and in the updated Behavior helper script.
- API Library - Lens Studio Asset Library now includes 3rd party APIs which can be used in lenses by Lens developers. See the Translation, Weather, Cryptocurrency, and Stock Market templates for examples.
- World Mesh - Provides 3D mesh reconstruction and depth texture of the real world for recent devices (even without LiDAR). Check out the various templates to see how you can populate the world semantically, do VFX collisions with the world, as well as make depth enabled shader effects.
Improvements:
- Enhancements to the VoiceML Text-To-Speech module which now includes 5 new female voice styles, a new male voice, and configurable playback speed. Check out the updated Text to Speech template to try it out.
- Audio Analyzer template has been updated to work with any audio track (try it with the new licensed audio sound library!), microphone, or even an array of raw audio samples. Additionally, the template now includes examples of driving material and VFX assets with audio data.
- VFX Collision template has been updated with an example of colliding VFX particles with 3D meshes through a depth buffer.
- New triggers and responses have been added to Behavior, including support for physics and 3D Text.
Fixed:
- Eye material in Face Morph template
- Lens Studio crash when disconnecting Spectacles 2021 from laptop
- different results in shader when using clamp and floor nodes
- position resets after duplication of mesh with pin-to-mesh
Lens Studio 4.7.2
Fixed:
- problem with resetting of camera layer for prefabs
- crash with using image texture in Camera’s render target
Lens Studio 4.7.1
- Fixed problem with textures missing on certain imported assets
Lens Studio 4.7
New:
- SDF (Signed Distance Field) generator - Allows creators to generate a 3D signed distance field texture from any 3D mesh. This is a powerful data format that opens the door to advanced techniques for fast, accurate collisions and to volumetric effects. See the example in the VFX Collision guide for more information.
- Media Picker - Allows creators to use an image or video from their device's camera roll as a texture. This is an enhancement to Image Picker, and Face Image Picker. See the Green Screen template to see it in action.
- 3D Text - Generate 3D meshes from text easily using the Text3D Component. See the 3D Text template for examples.
- 3D Hand VFX Template - A template that combines the using of 3D Hand and VFX effect
Improvements:
- Primitive collider shape type is available in the Collider component. It now supports primitive shapes with non-uniform scale.
- New cloth simulation examples for body tracking and primitive collider in Cloth Simulation Template
- Preview video now supports audio for VoiceML and AudioML
Fixed:
- Various bug fixes and performance improvements
Lens Studio 4.4
We jumped from Lens Studio 4.1 to Lens Studio 4.4 because we are internally organizing our build & versioning system. Rest assured that you are not missing out on any functionality - this is purely a new naming convention!
New:
VoiceML - Trigger AR effects and command the Snapchat camera with your spoken words or convert text-driven Lenses to speech with new VoiceML modules:
- Speech and Command Recognition Module - Transcribe text or define specific keywords that trigger AR effects. This feature has two templates: Speech Recognition Template and Voice UI Template
- Text-To-Speech (TTS) Module- Convert text to automated oral speech. This feature has a Text To Speech Template
- System Voice Commands - Enable In-Lens Voice Commands in Snapchat's Camera Tab such as "Take a Snap" or "Record a Video". Check out the helper in the Asset Library to add this function to your Lens.
3D Hand Tracking - Trigger and attach AR effects to hand movements in 3D space. This feature has two templates:
- 3D Hand Tracking Template - to track 3D hand model to match your left and right hand
- 3D Hand Interactions Template - to track 3D hand and create custom interactions
- External Body Mesh - Automatically attach and deform 3D custom meshes with the body pose and shape. This feature has the Try On Template which allows you to create a set of outfits that automatically deform to any body without a rig.
- 3D Skeleton Display - View and manipulate joints of imported rigged meshes within Lens Studio
- Upper Body Skin Segmentation - Mask the skin on one’s upper body excluding their clothing and hair. This feature comes with Portrait Skin Segmentation Template
- Connected Lenses Development Tools - Invite other Snapchatters to join a Connected Lens session in development by pushing the unsubmitted Lens to their paired account
Improvements:
- Improved search when adding nodes in VFX graph, Material graph, and visual scripting
- Ability to sort templates by name and complexity
- Ability to test single plane tracking of Spectacles 2021 Lenses within Lens Studio Interactive Environment
- Auto-matching of 3D Body and 3D Hand model joints based on hierarchy
- Interactive Environment supports Depth Texture
Fixed:
- Various bug fixes and performance improvements
Lens Studio 4.1.1
Improvements:
- Various bug fixes and performance improvements
Lens Studio 4.1
New:
- Installer size reduced from 1.7GB to 600MB, which will lead to faster downloads of Lens Studio
- Templates are no longer installed, but will need to be downloaded on-demand
- Lens Size Limit Increase - Increases the Lens size limits from 4MB to 8MB
- Lens Text Localization - Allows creators to add their own localized text assets to Lens Studio from a JSON file
- Upper Garment Segmentation - Enables multi-person garment segmentation from garments like shirts, vests, coats, hoodies and dresses
- Multi-Object Detection - Detect where in the camera certain objects are, and add effects to them
- Order Independent Transparency - Enables rendering of more complex objects with semi-transparency
- Scan updates, such as triggers, templates & markers. This will enable 2D bounding box detection of things such as cup, car, dog, cat, bottle, etc
- Remote Lens push for Spectacles 2021 is enabled
Improvements:
- Texture Compression now supports JPEG
Fixed:
- Various bug fixes and performance improvements
Lens Studio 4.0
New:
- Connected Lenses. Create shared experiences with Connected Lenses that allow multiple people to play, explore, build, and dream together, whether they’re in the same room or miles apart!
- Scan. Build Lenses that react to things that are visible in the camera. Scan’s Visual Classification feature recognizes over 500 object and scene categories in the physical world.
- Multi-Body 3D Mesh. Industry-defining algorithms can reconstruct a subject’s entire body and hands as a 3D mesh. You can even capture multiple persons simultaneously to maximize your creative options.
- VFX Editor. Design stunning visual effects with the ultra-powerful VFX Editor, our brand new node-based particle simulation engine. From rain, to magical powers, to swarms of a million emojis, your imagination drives what’s possible. It’s fully optimized for desktop and mobile devices.
- SnapML Audio. Sound is power. Train a model and create sophisticated, multi-sensory experiences with audio-activated Lenses. SnapML Audio can identify and react to human speech, ambient noise, languages, music, and thousands of everyday sounds that you can use to trigger limitless workflows.
- Cloth Simulation. Incorporate realistic textiles into your Lens designs with 4.0 Cloth Simulation. Progressive, physics-based mapping means virtual fabrics look and move like the real thing. Experiment with innovative patterns and textures or stick to the basics.
- Hair Simulation. Create visionary styles with enhanced, 4.0 Hair Simulation. Customize colors, textures, length, and even simulate wind with realistic modeling that replicates hair physics and accounts for various face shapes. For added versatility, import customized styles from partner design programs.
- Integration with Spectacles (2021). Design, build and deploy immersive experiences for Spectacles (2021)
Improvements:
- Dynamic Environment Maps. Bring more realism to your creations by projecting the real world onto a virtual one
- Spatial Audio and Mix To Snap. Create immersive audio experiences for Snapchat and Spectacles (2021) and let your audience enjoy higher quality audio in their Snaps.
Fixed:
- Various bug fixes and performance improvements
Lens Studio 3.4.2
- Change log not available for this version
Lens Studio 3.4.0
New:
- Multi-Person 3D Full-Body Tracking - overlay virtual outfits, attach virtual objects to your body, or drive animated 3D characters with this new capability. Tracking of several bodies and tracking of partially visible bodies is supported.
- Full-Body Segmentation - segmentation mask to apply custom effects to the entire body or background
- Hand Joints Tracking - track the joints of the fingers and the wrist to apply or trigger effects
- Asset Library - access a library of scripts, materials, SnapML models, plugins, audio and more that make it easier to build more complex Lenses!
Improvements:
- Device Simulation updated to the most recent Snapchat UI
- Interactive Preview in Preview Panel improvements - movement to specific location of a scene, locking Y coordinate of position
- Added the option to overwrite initial project file during project updates
- SnapML now loads models asynchronously in order to optimize loading time, either uses a callback function onLoadingFinished or uses a function waitOnLoading
- SnapML now supports TensorFlow Lite float/quantized models
- SnapML now supports new Layers - Embedding, RNN, BatchMatMul
- ONNX/TF import – various improvements, learn more in the ML Compatibility table
- Depth data from the iOS LiDAR scanner is applied to Depth Texture, including Depth Enabled Templates
- Material Editor improvements as ability to allow using the Bool Parameter node with other relational nodes (such as equal, greater than, etc.) while maintaining its static capabilities, unpack node precision update.
Fixed:
- Various bug fixes and performance improvements
Lens Studio 3.3.3
Fixed:
- Lens publishing and My Lenses bug fixes
- Various bug fixes and performance improvements
Lens Studio 3.3.1
- Fixed: Various bug fixes and performance improvements
Lens Studio 3.3.0
New:
- Visual Scripting – Create custom interactivity using node-based scripting, without coding
- My Lenses 2.0 – Manage your Lenses in browsers outside the Lens Studio application
- Texture Compression – Pack in richer assets for more compelling Lenses with automatic tunable compression inside the app
- Logger – Group, filter, and search messages in the logger view
- Face Morph Template – Morph a face in 3D using a custom mesh
- Configuration Template – Use UI widgets to create an adjustable Lens
- Tween Template – Set up animations using a dropdown menu
Improvements:
- Support for Apple-silicon based Macs
- Device Simulation Snapchat UI updated to the most recent one
- Ability to reset a Lens during recording
- SnapML performance improvements including Elu, Softplus, Softsign for Android GPUs and various CPU optimizations
- SnapML supports new Layers – LSTM, Permute
- ONNX/TF import – various improvements, learn more in the ML Compatibility table
Fixed:
- Fixed various issues in SnapML export from pytorch 1.7
- 'Optimize project' no longer deletes unused ML models
- Various bug fixes and performance improvements
Lens Studio 3.2.0
New:
- Hand Segmentation Template - shows you how to add an image to the hand, as well as occlude things behind the hand. In addition it demonstrates how you can use hand gestures to control the effects around the segmented hand.
- Behavior Template - demonstrates how you can use the Behavior Helper Script to set up different effects and interactions through a dropdown menu. You can choose different triggers like face or touch interactions, and respond to them with effects like enabling objects, playing tweens, and more!
- Search for Templates and recent projects - use Search bar in Home Screen to quickly find a template or recent project.
- Head Mesh - track a user’s whole head shape including skull.
- Post Effects - Smoothing, Gaussian Blur
- World Mesh - A dynamic mesh object that provides semantic understanding of the environment, raycasting capabilities, occlusions and more. (Note: available for iOS devices w/ ARKit 3.5+ and a rear-facing LiDAR sensor)
- Interactive Preview - An interactive preview mode that uses a virtual 3D scene (rather than images or videos) with controls for looking and moving around with 6 degrees of freedom
Improvements:
- Material Editor script nodes improved with possibility to upgrade nodes from previous versions.
- Ability to create an animation atlas smaller than 256 pixels
- Support of webp image format is added
SnapML performance improvements:
- Instance Normalization layer in Android GPU (more than 100% faster)
- Nearest neighbor upscale in Android GPU
- Global Average Pooling in Android GPU
- Various CPU optimizations
SnapML new Layers added:
- Sin
- Cos
- Argmin/Argmax
- Concat and eltwise now works with constant node
- ONNX/TF import - various improvements, find out more in the ML Compatibility table.
- Behavior Script can now trigger Lens hints, script APIs, go through a list of custom triggers, as well as check distance between screen transforms
Fixed:
- Fixed - Device Tracking Rotation doesn't work in preview
- Fixed various issues in SnapML export from the pytorch 1.6
- Various bug fixes and performance improvements
Lens Studio 3.1.0
New:
- Full Body Triggers Template - Use Full Body Tracking to trigger effects depending on the pose of the user, as well as when a joint hovers over a screen position. This template is great for dance related videos
- Full Body Attachments Template - Attach objects between joints provided by Full Body Tracking. It comes with primitive objects attached between each tracking joints used to approximate an occluder for objects to go around
- Material Editor Search - Find nodes with a new search feature
Improvements:
- Export multiple objects to .lso format
Start and stop particle generation using corresponding API methods available. Take a look at the - Particles Template to learn more
- Replace one resource with another all over the scene for meshes, materials and sounds
- Hide/show the grid in the 3D Scene
- Updated face images/videos to a new wide format (much larger horizontal Field of View)
- ONNX/TF import - various improvements, find out more in the ML Compatibility table
Fixed:
- Fixed flipped textures after glTF import
- Various bug fixes and performance improvements
Lens Studio 3.0.1
- Fixed: Various bug fixes and stability improvements
Lens Studio 3.0
New:
- SnapML - Bring your own neural networks to Lens Studio! Train a model and import it to create never-before-seen Lens effects!
- Style Transfer Template - Stylize the camera to look like a painting, sketch or whatever your imagination can think of!
- Object Detection Template - Find and track arbitrary objects in the camera. The provided template tracks cars, but you can use the example notebook to train a model to detect any object!
- Glasses Classification Template - React to a person wearing glasses. The example notebook can be used to train a model to classify other objects that you have training data for.
- Pizza Segmentation Template - Get a custom segmentation mask and use it to apply unique visual effects. The provided model masks pizzas, but you can retrain the network to segment anything you have training data for.
- Ground Segmentation Template - Apply visual effects that transform the world around you using the ground segmentation model.
- Face Expressions Template - Use 3D face mesh blendshapes to animate a custom 3D character.
- Face Landmarks Template - Leverage 2D face tracking landmarks to drive interesting visual face attachments.
- Hand Gestures Template - Use common hand gestures like pointed index finger, thumb and the peace sign to trigger sound effects. Modify to use as triggers for your custom effects.
- 3D Eyeball Tracking - Replace or augment eyes in full 3D, including realistic gaze tracking!
Improvements:
- Refreshed UI with two themes - See more information in the Object, Resource and Inspector panels with an all-new look. Includes more intuitive icons and convenient ‘Close to Home’ button.
- Dock a minimized preview in scene panel - Keep the preview panel visible without taking up as much screen space by docking it in the lower-right corner of the Scene Panel
- Script Editor - multiple UX improvements.
- Material Editor – new types of nodes were added as loops, access to light source properties, working with matrices.
- HDR Compressed Textures - option to compress environmental map textures to decrease the archive size of your Lenses.
- Screen Texture - simplified moving of effects between cameras by adding the alias of current render target.
- Mesh Precision - ability to switch vertex attribute format of any mesh.
- Materials - added extended frustum culling and instance count.
Fixed:
- Fixed iss
- OperaOpera 115.0 Build 5322.77
- PhotoshopAdobe Photoshop CC 2024 25.12
- OKXOKX - Buy Bitcoin or Ethereum
- BlueStacksBlueStacks Air 5.21.650
- Adobe AcrobatAdobe Acrobat Pro 2024.005.20320
- TradingViewTradingView - Track All Markets
- ParallelsParallels Desktop 20.1.2
- 4K Video4K Video Downloader+ 1.10.3
- CleanMyMacCleanMyMac X 5.0.3
- 4DDiG4DDiG Mac Data Recovery 5.2.2
Comments and User Reviews