Apple WWDC 2024 Key highlights: iOS18, watchOS11, tvOS18, iPadOS18, macOS Sequoia unveiled; Apple Intelligence, Apple's new name for AI, announced and more

Tim Cook is back on stage thanks everyone. It's also wrap from out side.

Apple says: "We are just getting started." Apple Intelligence is coming to iOS18, iPadOS18 and Mac Sequoia later this year.

Apple Siri is getting the biggest update, thanks to Apple Intelligence. Users will be able to speak to Siri much more naturally in iOS 18. Apple said that you will be able to type to Siri to get things done instead of just talking. Siri will also be able to do things like set up scheduled text messages and understand from the context of what you’re saying what apps you’re asking it to use. It is also getting a new glow -- on the sides.

The biggest talking point here is: "We want to extend the privacy and security of your iPhone into the cloud... we have created private cloud compute." When a user makes a request, the device decides if it can happen on-device or if it needs to go to the cloud. According to Apple, Private Cloud Compute cryptographically locks cloud to users iPhones and won't run unless the software can be inspected.

Apple Intelligence will work across apps on your Apple device. Users can say "pull up the files" or "play the podcast," and it can "orchestrate these and hundreds of other actions for you." You can also reference the content on your screen.

Apple Intelligence puts generative models at the core of iPhone, iPad, and Mac. "It protects your privacy at every step," asserts Apple. Seems privacy will be the name of the game here. On iPhones, 'Apple Intelligence' can now prioritise notifications. As for writing, it can write, summarise and condense text.

Back to Tim says, Craig. And Apple CEO is back on stage, talking about AI -- as almost everyone knew was coming. Yes, it is "Apple Intelligence". Cook cals it"the next big step for Apple".

Apple officially announces macOS 15 Sequoia at WWDC 2024. One of the first features coming to the OS is iPhone mirroring. This means users can control their iPhone from their Mac. Your iPhone stays locked while in mirror mode, and it'll even stay in StandBy mode. macOS now also has automatic window tiling. Apple has also updated Safari with a bunch of new features, including highlights. It also has Viewer mode for on-page video content.

Apple iPad is finally getting the much-awaited Calculator app as part of iPadOS 18. On its face, the app looks a lot like the calculator you might be familiar with from Apple iOS on iPhones. But it also supports Apple Pencil, meaning that users can write down math problems and the app will solve them thanks to the feature Apple calls Math Notes.

Apple announces watchOS 11 for your Apple Watch. The updates make the Apple Watch more of a convenient lifestyle device beyond just a fitness device. A new app is coming for Health. watchOS 11 will bring Vitals app to let users check in on your most important health metrics at a glance, including things like heart rate. New watch faces too are coming. watchOS 11 will help users find the best photos for their Photos face. It'll help suggest colours and themes too. Live activities will also be supported on the Smart Stack, as well as Check In to let loved ones know when you get home safe. In 2023, Apple brought the Smart Stack to watchOS. This time, it will automatically add new widgets when you need to see precipitation before it rains.

Many a times, users can't recall the name of an actor or a song title during a show. Apple is launching Insight to show these details in realtime when you're watching an Apple Original title. Viewers can add music from Insight to an Apple Music playlist. Dialogue enhancement uses machine learning and will work with more receivers and speakers. Subtitles go more convenient. "We now have a setting three levels deep for enhancing dialogue," says Apple.

Ron Huang on stage. Huang is the VP of Sensing. This means time for Siri updates. For starters, Siri access is getting easier. This is BIG: If you don't want to speak loud to respond to Siri, you can just nod your head or shake to interact and indicate yes or no. Voice isolation too is coming to AirPods Pro.

The Photos app is getting its "biggest redesign ever," according to Craig Federighi. Users can filter out screenshots or search for specific types of content. The space below the photo grid to feature "Collections," which is groups of photos automatically categorised by the app. This includes photos from recent days, or those featuring specific people. Users can also revisit trips easily.

Mail app is getting better categorisation. New "digest" email that contains all the emails from a specific business so you can quickly scan info. There will be new organisation features like a Primary category that sorts for senders you know and timeliness. The Mail app is also organising things into shopping, promotions and more. Categorisation will be available later this year.

Apple announces ability to bold, underline, and italicise text in Messages. Scheduled messaging comes to iMessage. New text effects include jitter, shake and bounce. Satellite messaging support on messages iPhone 14 and beyond.

Swiping from the top right, like usual, will bring down your control centre. Users can now swipe through multiple groups of controls, like for media playback. They can now also see all their home controls in one page. Developers can add controls for you to pin here. All in all this means: More toggles for your most important features, with media and smart home controls getting prominent placement.

iOS 18 is a big release this year. Home Screen gets a tons of more controls. Get ready for several more ways to customise your iPhone. In addition to wallpapers, icons and widgets, users will now be able to arrange apps and widgets to frame their wallpapers better. Options include: Place them to the side or right above the dock for easier access. As rumoured widely, there's also a new look in Dark mode.

Vision Pro is coming to three new countries in June --- China, Japan, and Singapore on June 28. Five new in July -- Australia, Canada, France, Germany and the UK on July 12.

VP Mike Rockwell starts with some numbers: over 2,000 Vision Pro apps and 1.5 million compatible iPhone and iPad apps. VisionOS 2 officially announced. Spatial Photos comes to Photos app. visionOS 2 allows users to turn 2D images into 3D spatial photos, and you can use SharePlay to view Spatial Photos and panoramas with other users. There are also some new UI integrations. Apple is also making it easier to create new spatial content, like Spatial Video.

Apple CEO is starting with visionOS updates, the software that powers Apple VisionPro launched earlier this year.

Apple is promising viewers new originals "each and every week" in the coming months.

Apple CEO Tim Cook wants you to look forward to incredible updates across company's lineup. Starts with Apple TV Plus, which is celebrating its 5th anniversary this year.

WWDC 2024 is live. Apple CEO Tim Cook kicks off the company’s biggest software event of the year – WWDC 2024. “Good Morning,” welcome to WWDC: Tim Cook

Apple is making a significant leap into the world of Artificial Intelligence (AI) with its new initiative, "Apple Intelligence," according to a Bloomberg report. This focus prioritises practical features that enhance user experience, rather than "whiz-bang" technology like image or video generation. While the official launch is expected alongside iOS 18, macOS 15, etc. this fall, these initial AI features will be offered as a beta test. Overall, Apple Intelligence seems geared towards making everyday tasks on your Apple devices more efficient and streamlined. Stay tuned for the official announcement at WWDC to learn more about the specifics and potential of this new AI initiative.

While details surrounding the next Apple Watch software update have been scarce, recent reports hint at potential changes to the Siri interface and the Fitness app. This could signal a focus on improving user interaction with the virtual assistant and potentially introducing new fitness features or functionalities at WWDC 2024.

Just like iOS 18, macOS 15 is expected to be heavily influenced by Artificial Intelligence (AI). Many of the features Apple unveils are likely to be optimised for Macs powered by the M1 chip, taking advantage of its processing power. The rumoured changes for macOS 15 include: System Settings Revamp -- Navigating system settings might become a breeze with a much-needed overhaul. Smarter Siri -- The Siri overhaul coming to iPhones is expected to translate to Macs as well, potentially offering a more intelligent and helpful virtual assistant. AI-powered Apps -- Look forward to AI integration in core apps like Calculator, Notes, Safari, and Voice Memos. These updates could bring features that leverage AI to enhance functionality and streamline workflows.

Apple's upcoming iPad software update, iPadOS 18, is rumored to mirror many of the features coming to iOS 18, including a focus on Artificial Intelligence (AI). This could significantly enhance the user experience on iPads. One long-awaited addition for iPad users is a built-in calculator app. Finally, no more reliance on third-party options. There are also whispers about features specifically designed for the rumored Apple Pencil 3. However, details may be scarce until the stylus itself is released, possibly this fall. The rumored "squeeze" feature, potentially triggering the eraser tool, is a prime example. We'll likely need to wait for the official announcement or the product launch to learn more about these Apple Pencil 3 integrations.

Apple is set to challenge established players like 1Password, LastPass, and Dashlane with its own password manager app, according to a new report. This standalone app, built upon Apple's existing iCloud Keychain technology, aims to provide a more user-friendly and feature-rich experience for managing passwords across devices. Expected to be unveiled at WWDC today, the Apple Passwords app will reportedly sync seamlessly between iPhones, iPads, and Macs running iOS 18, iPadOS 18, and macOS 15 respectively. The app's functionality is also rumored to extend beyond Apple's ecosystem, offering compatibility with Windows computers and even Apple's upcoming mixed reality headset, the Vision Pro. This move suggests Apple is aiming to streamline password management for its users, potentially offering features similar to its competitors, such as secure password storage, automatic login, and strong password generation.

Apple WWDC 2024 is likely to showcase new versions of tvOS, the software powering Apple TV devices, and VisionOS, the operating system for the Vision Pro headset. While a major overhaul for visionOS might not be on the cards this time, we can expect updates in two key areas. One, Vision Pro App Compatibility, the update will likely focus on expanding the availability of existing iPad apps for the Vision Pro, allowing users to enjoy a wider range of content and experiences. Two, new Vision Pro Environments. The update might introduce new virtual environments within the Vision Pro, potentially offering fresh and immersive experiences for users.

Get ready for a more refined Dark Mode experience in iOS 18! According to MacRumors, app icons will finally adapt to Dark Mode, sporting a darker tint to match the system theme. Additionally, app access might be secured using Face ID or Touch ID on every launch. This app icon colour change aligns with previous rumours about iOS 18 offering wider screen layout customization options. MacRumors suggests apps might have the ability to automatically adjust their icon colour based on the system's Dark Mode setting. The specific implementation remains unclear, but possibilities include developers providing separate light and dark icons for automatic switching, or the OS applying a dark theme filter to a single icon asset. While MacRumors mentions Apple's own apps like Music and Mail, it's likely third-party developers will also have the option to support this feature, further enhancing the overall Dark Mode experience in iOS 18.

There have been rumours that Apple has been working to build an Amazon Astro-style robot that can follow a user around the home and help handle chores. Some Apple executives are said to have even discussed the prospect of humanoid robots. It remains to be seen if this robot will be the hardware announcement of WWDC 2024. There have also been speculations about HomePod with a display, similar to Amazon Echo Show.

Apple's Vision Pro already uses artificial intelligence to handle some capabilities, like understanding its external surroundings. And those kinds of features could help pave the way for AR glasses or camera-equipped AirPods. This will enable them to be able to see the world around them in order to offer pertinent information to users — either to their eyes or ears. The new health features, like the coach and noninvasive glucose sensing, may also likely rely heavily on AI processing.

Apple may announce Vision Pro going to more countries. Though it is not sure how much market a product with a $3,500 price tag may fine. From a practical standpoint, it’s more of a proof of concept for developers than a consumer product. The best scenario is that this device lays the groundwork for something with more appeal, such as $1,500 augmented reality glasses. If that happens, then the Vision Pro will have been more than worthwhile for Apple.

The Music app might get a smarter song transition feature, while Audio Passthrough (details unclear) could be linked to Spatial Audio for an even more immersive listening experience. Gamers might enjoy features like Spatial Gaming with hands-free controls. Freeform app is rumored to be getting a "Scenes" feature, which could allow for easier navigation and editing within specific areas of your brainstorming boards.

Apple might offer more freedom to personalize your home screen layout, although specifics remain under wraps. Users may be able to unleash your creativity with the rumored ability to design your own emoji in iOS 18. You might even be able to customize app icons for a truly unique look. It may also be time to say goodbye to juggling separate reminders and events! A unified system across iOS 18 and macOS 15 could streamline your tasks and keep you organized.

While AI steals the show, there are whispers of other exciting features coming to iOS 18. These include iMessage getting a revamp with Text effects, message formatting, and even compatibility with RCS messaging might be on the horizon for iMessage, making your chats more expressive and functional. Speculations also suggest Safari may gain a "Browsing Assistant" and "Encrypted Visual Search" features. The assistant might help you find what you need on the web more efficiently, while encrypted visual search could offer a more secure way to search using images.

Apple Photos app too is likely to embrace the power of AI with a feature called "Clean Up." This feature could leverage generative AI to allow users to effortlessly remove unwanted objects from photos. Imagine removing that pesky photobomber or cleaning up a cluttered background – all with a few taps.

Imagine a Siri that understands your natural language and responds with relevant suggestions. This could be a reality with the rumored integration of powerful AI models like ChatGPT. Apple's own Ajax LLM (Large Language Model) might also be implemented, allowing Siri to consider your calendar events, locations, and contacts to provide more helpful answers. Imagine asking Siri, "What restaurants are open near my work that I haven't tried yet?" and getting a personalized response!

Apple has since practically confirmed in hints that AI will be a big topic. In iOS 18, there are speculations that Apple will be incorporating AI into its various services, such as helping users write in Pages or create slides in Keynote. For developers, AI could help create software in the Xcode development environment, with functions to predict and complete blocks of code on their behalf. This could help developers streamline coding, and may even help with tedious tasks such as generating code for testing applications. Some buzz also hints at Apple providing access to AI apps in an enhanced AI App Store. It may be time for AI assistants in apps like Pages and Keynote. Imagine AI suggesting improvements to your writing style in Pages or recommending slide layouts in Keynote. There are even rumors of a dedicated AI App Store offering specialized tools to streamline your workflow.

WWDC has always been about software, with operating systems being the main highlight. Following Apple's usual naming conventions, the operating systems set to be unveiled later today are: Apple iOS 18, Apple iPadOS 18, Apple tvOS 18, and Apple watchOS 11. It's certain that Apple macOS will be version 15 this time around, however, it is not sure what Apple may call it. And not to forget visionOS, the OS for Apple's newest gadget -- Apple VisionPro.