Posts for: #Fp

Moving away from a legacy system using Scala and Kafka - Part 1

My team at Canal+ is building a new media asset management (MAM) platform. To put it simply, Mediahub, our platform, stores video files and information regarding these files:

  • Technical information (how many audio channels does this video have? what’s the video’s resolution?)
  • Editorial information (is it a movie? A show? A TV series episode? Who is speaking in the sequence? What about?)
  • Legal information (when can we air this content? When did we acquire this contract?)

On top of storing and exposing tools to manipulate video files and their related metadata, Mediahub allows third parties to send us new content that can be shipped to VOD platforms and TV channels. A built-in workflow orchestration engine takes care of receiving, quality-checking, assembling and shipping footage. The platform can execute hundreds of these workflows concurrently and treats more than 3000 workflows a day.

[Read more]

Working with JSON in Scala, a Circe Crash Course

This tutorial covers Circe, a functional JSON handling library for Scala, part of the Typelevel ecosystem and well integrated with Cats.

The video covers:

  • 00:00 The overall structure of the library
  • 04:43 The Json data type
  • 13:51 Encoders
  • 17:14 Decoders
  • 30:39 Automatic derivation
  • 32:33 Semi-automatic derivation
  • 34:55 Automatic derivation considered harmful and conclusion

A note about the placement of Json codecs and the “automatic derivation considered harmful” part of the video: placing our Encoder[YoutubeVideo] in the companion object of YoutubeVideo would have solved the problem. Since Scala automatically imports implicits from companion objects, we would have never forgotten the import in the first place.

[Read more]

Functional stream processing with Scala, a crash course on fs2

Fs2 is a Scala library for stream processing. This video is an introductory tutorial on fs2, which covers building streams, inifinte streams, effects, and files IO.

We use fs2 to read a very big CSV file (more than 3 GB), parse it, and transform every row to a JSON object, by taking advantage of the file reading and writing abilities of the library. No previous knowledge of fs2 is needed.

[Read more]

Functional error handling with monads, monad transformers and Cats MTL

The way we deal with failure in most OOP applications is itself a common source of unexpected behaviors. I believe exceptions and try/catch statements are overused. Most of the time, it isn’t obvious what a method might throw and when. Edge cases should be treated with the same amount of caution, if not more, than the rest of the code, yet they are rendered invisible by error-handling mechanisms that hide failures instead of highlighting them.

[Read more]