Imagen Term Glossary đź“°

Here you will find a glossary of terms used in the knowledgebase for reference

Table of contents


Imagen Terms

Media ID

The Media Object ID is commonly referred to as Media ID

Media Object

Any piece of media - Images, Videos, Audio, and Documents - will be contained within a Media Object. This will contain all renditions. as well as the original media (Media Elements

Media Elements

Contained within a media object, a media element represents the original file in storage - unless otherwise deleted by a retention policy in specific and rare use-cases

Records

Each Record will have a unique recordID. This can be found in the URL (below) or by editing a record

Organisation

An Imagen organisation stores the IDP’sconfiguration details. When auser initiates the login process, they first choose their organisation, which will in turnredirect them to the IDP’s login form

Departments

Departments are Imagen Roles that existbeneath an Imagen Organisation (one organisation to many departments). Specific SSO attributes can bemapped to a Department, and Departments can be associated with Imagen Groups,making it possible to configure ACLs per Department

Metadata Display

Metadata qualifies all textual information attached to media files. This includes a file's Name, Title, Description, Summary, Keywords, Date, etc. Imagen categorises Metadata into fields, where each field identifies a defining aspect of the media file. Accurate Metadata improves the user experience in seraching their platform for media and filtering through results.

Metadata is asked for upon manual file upload (some fields can be mandatory), can be informed post-upload, can be pulled in from other MAM systems, or translated from files used by other databases using XML mappings (e.g. .XML, .XLS, etc.).

The Metadata Schema defines the architecture of Metadata Fields to inform media. Each metadata field can be set to a different type. These types are: 'Text', 'Comma Separated Value' ('CSV'), 'Date', 'Time', 'Date Time', 'Number', 'Keyword Single Select/Exclusive', 'Keyword Multi-Select' and 'GUID'. Metadata Fields can be required before file upload, set to be searchable by the main search engine, and be considered as filter options.

AFD - Accelerated File Delivery

Imagen's file acceleration offering. This is an application user install on their devices to make transfers from Imagen platforms speedier via multi-channel downloading in chunks as opposed to just in the browser. The exists in PC & MAC compatible versions. Displaces other file acceleration solutions including Aspera, Signiant, and FileCatalyst.

Imagen's AFD application also allows users to link their machine running AFD to their Imagen account. This allows them to send downloads to other machines (for instance Edit Workstations or machines linked to Networked Storage) from any device, and trigger downloads to start as soon as transcoded files are ready to download from Imagen.


Technical Jargon

Conditional operators

An operator specifies the type of operation to be applied to your condition, for example,

= the value is equal to

< the value is less than

> the value is greater than

 

Service Provider

The ImagenWeb instance e.g. PremierLeague Archive, ImagenGo providing the “service”

Identity Provider

The service providing the user’sidentity e.g. Microsoft, Google, Bournemouth university

Attributes

When a user is sent from their IDP backto ImagenWeb, we’ll be able to useattributes released by their IDP that uniquely identify that user. The following attributesare the most important:○urn:oid:1.3.6.1.4.1.5923.1.1.1.10(eduPersonTargetedID):This must be aunique ID that very rarely changes (i.e. this is a user ID). If it ever changes, seethe User account merging point below. This is arequiredattribute.○urn:oid:0.9.2342.19200300.100.1.3(mail): The user’semail address. This isused to pre-populate the user’s registration form when theyfirstvisit ImagenWeb.The user can opt to use a different email address if so desired.●

User account merging

If the user’s eduPersonTargetedIDever changes, ImagenWebwill see them as a new user and treat them accordingly. If a user wishes to regainaccess to their previous account/use their previous email address, they will need tomerge their accounts. The previous email address will be sent a message containing alink that initiates the merge and transfers the previous user’s content (collections, etc)before ultimately deleting the previous account

WAYFless URLs

Shareable URLs that will sign a userinto a specific IDP beforeredirecting to the target, for example:https://imagenweb/start-session?entityID=YOUR_IdP&target=https://imagenwebwhereYOUR_IdP is the Entity ID of an IDP.â—Ź
Entity ID: The SP and IDP have an Entity ID. The SP’sentity ID can be found on thehttps://imagenweb/ssoserviceprovider/adminpage, whilsteach IDP’s Entity ID can befound on its respective Organisation admin page

Federations

A federation is a collection of IDPs.If you add a Federation toImagenWeb, it’s a quick way of trusting dozens of IDPs at the same time. In Imagen’scase, we subscribed to a Federation containing dozens of UK universities, which each have their own ways of authenticating users. An organisation can be created which is linked to an IDP derived from a Federation

Live Streaming

Imagen offers the option to display and ingest live streams. This treats a live RTMP Stream (Real-Time Messaging Protocol Stream) as a piece of media, encoding a web proxy on the fly creating a growing file. Platform users may clip from live, annotate media and timeshift (jump back through the feed).

The live streaming functionality prcesses streams up to 5Mbps (not full HD) and creates a 1Mbps proxy live, and clips will be mae from this. After the event has ended, Imagen will re-encode the file to the platform's proxy quality.

Live streaming currently relies on manual scheduling of live transcoding resource by our Client Services team. For pricing, please consult deployment.

Metadata Display

Metadata qualifies all textual information attached to media files. This includes a file's Name, Title, Description, Summary, Keywords, Date, etc. Imagen categorises Metadata into fields, where each field identifies a defining aspect of the media file. Accurate Metadata improves the user experience in searching their platform for media and filtering through results.

Metadata is asked for upon manual file upload (some fields can be mandatory), can be informed post-upload, can be pulled in from other MAM systems, or translated from files used by other databases using XML mappings (e.g. XML, XLS, etc.).

The Metadata Schema defines the architecture of Metadata Fields to inform the media. Each metadata field can be set to a different type. These types are: 'Text', 'Comma Separated Value' ('CSV'), 'Date', 'Time', 'Date Time', 'Number', 'Keyword Single Select/Exclusive', 'Keyword Multi-Select' and 'GUID'. Metadata Fields can be required before file upload, set to be searchable by the main search engine, and be considered as filter options.

PFR - Partial File Restore

PFR ('Partial File Restore' or 'copy codec') is the process of creating a clip from a longer video file whilst keeping the original file's format without transcoding. This ensures no loss of quality occurs with transcodes and files are prepared more speedily than if a transcode were to occur. Whilst an industry recognised practice, most media professionals may not know of Partial File Restore or its benefits.

Imagen currently supports PFR on three very specific file types:

  • - MXF DNxHD 120 - an AVID developed format, the most common broadcast format for HD content
  • - MXF XDCAM HD422 - Commonly used Sony HD Format
  • - MXF IMX 50 - Selected by Imagen as the format to digitise SD tapes to (@50mbps)

A detailed understanding of a client's post-production workflow (with the provision of sample files, ideally) is required before confirming the availability of the option.


Integrations

Byte range requests

To speed up data transfer, Imagen will request small chunks of a file at a time. Therefore the HTTP(s) server from which the media originates must support byte-range requests. 

Metadata Display

Metadata qualifies all textual information attached to media files. This includes a file's Name, Title, Description, Summary, Keywords, Date, etc. Imagen categorises Metadata into fields, where each field identifies a defining aspect of the media file. Accurate Metadata improves the user experience in searching their platform for media and filtering through results.

Metadata is asked for upon manual file upload (some fields can be mandatory), can be informed post-upload, can be pulled in from other MAM systems, or translated from files used by other databases using XML mappings (e.g. XML, XLS, etc.).

The Metadata Schema defines the architecture of Metadata Fields to describe the media. Each metadata field can be set to a different type. These types are: 'Text', 'Comma Separated Value' ('CSV'), 'Date', 'Time', 'Date Time', 'Number', 'Keyword Single Select/Exclusive', 'Keyword Multi-Select' and 'GUID'. Metadata Fields can be required before file upload, set to be searchable by the main search engine, and be considered as filter options.

Metadata / Translating Mapping

Metadata mapping is the task of creating translation rules to automatically convert metadata information from different source files to match Imagen's field schema. Imagen may also create rules to split single fields into multiple, for example from Filenames (2019_09_01_Filename) or folder structures (Sport > Event > Project Name > File Name).

 

 


Cloud/Distribution

Cloud Storage

Cloud storage is the resource provided by a data centre to hold data for clients. Some providers will offer different commercial models of storage based on access frequency/retrieval rates, usually referred to in temperature scales or access frequency but using the same underlying technology (spinning discs). Imagen's preferred Cloud Service Provider is Microsoft Azure, tiered as follows:

  • Hot - high-frequency access with a fixed storage rate. There are no storage charges to put or retrieve from this storage.
  • Cool - lesser accessed, there are charges for initial deposit and retrieval of content. The dormant rate of cool is lesser than Hot.
  • Archive - Imagen does not cater to Azure's Archive storage tier.

The storage location should be chosen to place media closer to the people accessing it to reduce latency. Some media profiles (Proxies, Thumbnails, Reference Stills) will always be stored in hot storage.

Other cloud providers offer similar breakdowns. Alternatives include:

  • Amazon Web Services (AWS) - Standard, Infrequent & Glacier
  • Alibaba Cloud - Standard, Infrequent Access & Archive

Imagen has always deployed in Microsoft Azure but has conducted some compatibility tests in AWS environments. Should clients specifically request storage in AWS, this can be investigated further by our technical teams.

Load Balancing

To optimise resource utilisation, load balancing will distribute resource delegation evenly across multiple servers, networks, etc. 

Datacenters & Locations

A Datacenter (Datacentre) is a physical location for Cloud resources. This is where the servers, storage and network needed to power an Imagen system are located. Microsoft Azure, Imagen's preferred cloud provider, has over 50 different regions worldwide. Click here for an accurate list of their datacenters.

The datacenter location is key to effective distribution, and Imagen deployments should always aim to be closer to their audiences than to the physical origin of their media files.

Imagen offers a Replication Service that allows data to be located in two distinct locations, aiding delivery speeds and allowing for Disaster Recovery. This replication may also selectively duplicate files based on their Media Profile (e.g. Originals v. Proxies). Finally, Imagen can also integrate with Content/Global Distribution Networks (CDN, GDN) to provide faster playback and download of media is high activity is anticipated.

 

Serverless Code

In recent years, serverless code has become increasingly popular as a way to build and run applications. Serverless code is code that is executed without a server, instead running on a service provider’s infrastructure. This can provide a number of advantages, including reduced costs, increased flexibility, and improved scalability.

One of the main advantages of serverless code is that it can help to reduce costs. When you use a serverless code platform, you only pay for the resources that you use, rather than having to maintain your own server infrastructure. This can lead to significant savings, particularly for small businesses or startups.


Finally, serverless code can offer improved scalability. When your code is running on a serverless platform, it can automatically scale up or down based on demand. This can help to ensure that your application is always able to handle peak traffic levels without experiencing any downtime.

Services

Metadata / Translating Mapping

Metadata mapping is the task of creating translation rules to automatically convert metadata information from different source files to match Imagen's field schema. Imagen may also create rules to split single fields into multiple, for example from Filenames (2019_09_01_Filename) or folder structures (Sport > Event > Project Name > File Name).

Tape Digitisation

Tape digitisation covers the process of migrating tapes from physical formats to digital files. These may come from different physical tape formats, such as Betacam, LTO Tapes, XDCam HD, VHS, 35mm Film Reels, etc.

Imagen offers digitisation services for smaller tape libraries and can suggest partners who offer large-scale digitisation projects.


Commercial Agreements

NDA - Non-Disclosure Agreement

A non-disclosure agreement (NDA), also known as a confidentiality agreement (CA), confidential disclosure agreement (CDA), proprietary information agreement (PIA) or secrecy agreement (SA), is a legal contract between at least two parties that outlines confidential material, knowledge, or information that the parties wish to share with one another for certain purposes but wish to restrict access to or by third parties.

Imagen has a standard template NDA and can work from the basis of client NDAs if required.

MSA (UK Term) 

Master Service Agreement

This agreement will outline the terms for your Imagen platform. This could include;

  • Storage services
  • Imagen Storage replication 
  • Storage service redundancy and failure mitigation
  • Storage regions
  • Server performance
  • Bandwidth limits
  • Live streaming requirements
  • AI services for additional metadata extraction 

SSOW - Supplementary Statement of Works

This commercial agreement will define the terms of any work to be carried out by Imagen, in addition to those laid out in the MSA.

SOW - Statement of Works

This commercial agreement will define the terms and deliverables of work carried out by Imagen. For example, migration of an additional media catalogue.  


Acronyms

AVI - Audio Video Interleave

Audio Video Interleave (also Audio Video Interleaved), known by its initials AVI, is a multimedia container format introduced by Microsoft in November 1992 as part of its Video for Windows software. AVI files can contain both audio and video data in a file container that allows synchronous audio-with-video playback.

Imagen supports this file format upon ingest and proxy creation, but cannot restore clips in this format.

 

OBS - Open Broadcaster Software

Open Broadcaster Software is a free and open-source cross-platform streaming and recording program built with Qt and maintained by the OBS Project. There are versions for Windows, macOS and Linux distributions, such as Ubuntu.

Imagen supports live feeds from OBS.

Not to be confused with OBS - Olympic Broadcasting Services or OBs - Outside Broadcasts.

EDL - Edit Decision List

An edit decision list or EDL is used in the post-production process of film editing and video editing. The list contains an ordered list of reel and timecode data representing where each video clip can be obtained in order to confirm the final cut.

EDLs are created by offline editing systems or can be paper documents constructed by hand such as shot logging. An Online Edit means the editor is using the high-resolution files directly, which allows fast turnaround but is resource intensive. Offline Editing means the editor is working with proxies or low-resolution reference copies, and the EDL allows the system to go and pick up the originals in their original quality to create the final export in full quality.

While clips can be made and ordered on the Imagen platform, the product does not currently offer EDL exports.

The difficulty in developing such a feature is that EDL formats such as CMX, GVG, Sony, Final Cut Pro, and Avid can differ in small (but important) ways. One example: just the file naming convention alone is different between Avid (32 characters) and FCPX (8 characters). That means that if Imagen would develop EDL functionality (and follow best practice by using the new XML standard) this may not work for all NLEs (Editing Systems).

 

MXF - Material Exchange Format

MXF is a container format for professional digital video and audio media defined by a set of SMPTE standards. A typical example of its use is for delivering advertisements to TV stations. An MXF file is identifiable by its file name, ending with '.MXF'.

MXF is a "container" or "wrapper" format that supports a number of different streams of coded "essence", encoded in any of a variety of video and audio compression formats, together with a metadata wrapper that describes the material contained within the MXF file.

MXF has been designed to address a number of problems with non-professional formats. MXF has full timecode and metadata support and is intended as a platform-agnostic stable standard for future professional video and audio applications.

Imagen supports this file format upon ingest and proxy creation, and can Partial File Restore (PFR) clips when the file is a compatible codec.

 

NDA - Non-Disclosure Agreement

A non-disclosure agreement (NDA), also known as a confidentiality agreement (CA), confidential disclosure agreement (CDA), proprietary information agreement (PIA) or secrecy agreement (SA), is a legal contract between at least two parties that outlines confidential material, knowledge, or information that the parties wish to share with one another for certain purposes but wish to restrict access to or by third parties.

Imagen has a standard template NDA and can work from the basis of client NDAs if required.

OBS - Open Broadcaster Software

Open Broadcaster Software is a free and open-source cross-platform streaming and recording program built with Qt and maintained by the OBS Project. There are versions for Windows, macOS and Linux distributions, such as Ubuntu.

Imagen supports live feeds from OBS.

Not to be confused with OBS - Olympic Broadcasting Services or OBs - Outside Broadcasts.

 

OB - Outside Broadcast

An Outside Broadcast qualifies a radio or television programme that is recorded or broadcast live on location and not in a studio. Typically these are conducted from a broadcast truck or mobile gallery which mixes the live feeds to create a broadcast output.

OTT - Over The Top

Over the top (OTT) is a term used to refer to content providers that distribute streaming media as a standalone product directly to viewers over the Internet, bypassing telecommunications, multichannel television, and broadcast television platforms that traditionally act as a controller or distributor of such content.

PFR - Partial File Restore

PFR ('Partial File Restore' or 'copy codec') is the process of creating a clip from a longer video file whilst keeping the original file's format without transcoding. This ensures no loss of quality occurs with transcodes and files are prepared more speedily than if a transcode were to occur. Whilst an industry recognised practice, most media professionals may not know of Partial File Restore or its benefits.

Imagen currently supports PFR on three very specific file types:

  • - MXF DNxHD 120 - an AVID developed format, the most common broadcast format for HD content
  • - MXF XDCAM HD422 - Commonly used Sony HD Format
  • - MXF IMX 50 - Selected by Imagen as the format to digitise SD tapes to (@50mbps)

A detailed understanding of a client's post-production workflow (with the provision of sample files, ideally) is required before confirming the availability of the option.

REST - Representational state transfer

The REST architecture definitions constrain how Interactions between systems should behave, enforcing a standard of security and performance for users to access resources. A web API that follows these constraints will be considered RESTfull. 

A REST API will normally make use of JSON and XML payloads (data to be sent to the API) in a similar way to HTTP(s) calls

RTMP - Live Streaming

Imagen offers the option to display and ingest live streams. This treats a live RTMP Stream (Real-Time Messaging Protocol Stream) as a piece of media, encoding a web proxy on the fly creating a growing file. Platform users may clip from live, annotate media and timeshift (jump back through the feed).

The live streaming functionality processes streams up to 5Mbps (not full HD) and creates a 1Mbps proxy live, and clips will be made from this. After the event has ended, Imagen will re-encode the file to the platform's proxy quality.

Live streaming currently relies on manual scheduling of live transcoding resources by our Client Services team. For pricing, please consult deployment.

SAN - Storage Area Network

A SAN solution pools together storage systems within a network and offers high-speed distribution to users connected to the network. This is more complicated and therefore not as easy to maintain as a NAS solution. 

SMPTE 

SMPTE is a standard for marking each frame contained within a media file. Imagen uses this standard for burnt-in timecodes and annotation features. 

Link to the Society of Motion Picture and Television Engineers (SMPTE)

NAS - Network Attached Storage

Usually comprised of a single unit - possibly containing multiple disks - this is a low-cost storage solution that is used by many home users and small businesses. This method is easier to maintain for an administrator than a SAN solution but still allows for distribution to users within a network.  


Storage

Cloud Storage

Cloud storage is the resource provided by a datacentre to hold data for clients. Some providers will offer different commercial models of storage based on access frequency/retrieval rates, usually referred to in temperature scales or access frequency but using the same underlying technology (spinning discs). Imagen's preferred Cloud Service Provider is Microsoft Azure, tiered as follows:

  • Hot - high frequency access with a fixed storage rate. There are no storage charges to put or retrieve from this storage.
  • Cool - lesser accessed, there are charges for initial deposit and retrieval of content. The dormant rate of cool is lesser than Hot.
  • Archive - Imagen does not cater to Azure's Archive storage tier.

The storage location should be chosen to place media closer to the people accessing it to reduce latency. Some media profiles (Proxies, Thumbnails, Reference Stills) will always be stored in hot storage.

Other cloud providers offer similar breakdowns. Alternatives include:

  • Amazon Web Services (AWS) - Standard, Infrequent & Glacier
  • Alibaba Cloud - Standard, Infrequent Access & Archive

Imagen has always deployed in Microsoft Azure, but has conducted some compatibility tests in AWS environments. Should clients specifically request storage in AWS, this can be investigated further by our technical teams.

Datacenters & Locations

A Datacenter (Datacentre) is a physical location for Cloud resource. This is where the servers, storage and network needed to power an Imagen system are located. Microsoft Azure, Imagen's preferred cloud provider, has over 50 different regions worldwide. Click here for an accurate list of their datacenters.

Datacenter location is key to effective distribution, and Imagen deployments should always aim to be closer to their audiences than to the physical origin of their media files.

Imagen offers a Replication Service which allows data to be located in two distinct locations, aiding delivery speeds and allowing for Disaster Recovery. This replication may also selectively duplicate files based on their Media Profile (e.g. Originals v. Proxies). FInally, Imagen can also integrate with Content/Global Distribution Networks (CDN, GDN) to provide faster playback and download of media is high activity is anticipated.

 

Storage

Storage qualifies the available digital resource to hold the media files in an Imagen system and is counted in TeraBytes (TB). The physical infrastructure of this storage will be provided by our Cloud Provider (Microsoft Azure) in a Datacentre chosen to suit the clients' needs.

Microsoft Azure assure triple local redundancy to secure data from technical failures. This means that at any given time data is stored in triple. If any copy is corrupted, it will be replaced with replication from the redundancy.

To calculate required storage needed based on hours & quality, you can use storage this calculator tool which includes the storage needed for proxies and other renditions.

 

XML sidecar

An XML sidecar file will describe a piece of media to accompany the media, or point to a location on the internet from which it can gain access to the media

   

Video Formats & Management

HLS Web Proxy

This is the video displayed to your users when interacting with the platform.  It is web-optimised for smooth and rapid playback. This file is stored in HTTPS Live Streaming (HLS) format. 

AVI - Audio Video Interleave

Audio Video Interleave (also Audio Video Interleaved), known by its initials AVI, is a multimedia container format introduced by Microsoft in November 1992 as part of its Video for Windows software. AVI files can contain both audio and video data in a file container that allows synchronous audio-with-video playback.

Imagen supports this file format upon ingest and proxy creation, but cannot restore clips in this format.

 

EDL - Edit Decision List

An edit decision list or EDL is used in the post-production process of film editing and video editing. The list contains an ordered list of reel and timecode data representing where each video clip can be obtained in order to conform the final cut.

EDLs are created by offline editing systems, or can be paper documents constructed by hand such as shot logging. An Online Edit means the editor is using the high-resolution files directly, which allows fast turnaround but is resource intesive. Offline Editing means the editor is working with proxies or low-resolution reference copies, and the EDL allows the system to go and pick-up the originals in their original quality to create the final export in full quality.

While clips can be made and ordered on the Imagen platform, the product does not currently offer EDL exports.

The difficulty in developing such a feature is that EDL formats such as CMX, GVG, Sony, Final Cut Pro, and Avid can differ in small (but important) ways. One example: just the file naming convention alone is different between Avid (32 characters) and FCPX (8 characters). That means that if Imagen would develop EDL functionality (and follow best practice by using the new XML standard) this may not work for all NLEs (Editing Systems).

MXF - Material Exchange Format

MXF is a container format for professional digital video and audio media defined by a set of SMPTE standards. A typical example of its use is for delivering advertisements to TV stations. An MXF file is identifiable by its file name, ending with '.MXF'.

MXF is a "container" or "wrapper" format which supports a number of different streams of coded "essence", encoded in any of a variety of video and audio compression formats, together with a metadata wrapper which describes the material contained within the MXF file.

MXF has been designed to address a number of problems with non-professional formats. MXF has full timecode and metadata support, and is intended as a platform-agnostic stable standard for future professional video and audio applications.

Imagen supports this file format upon ingest and proxy creation, and can Partial File Restore (PFR) clips when the file is a compatible codecs.

PFR - Partial File Restore

PFR ('Partial File Restore' or 'copy codec') is the process of creating a clip from a longer video file whilst keeping the original file's format without transcoding. This ensures no loss of quality occurs with transcodes and files are prepared more speedily than if a transcode were to occur. Whilst an industry recognised practice, most media professionals may not know of Partial File Restore or its benefits.

Imagen currently supports PFR on three very specific file types:

  • - MXF DNxHD 120 - an AVID developed format, the most common broadcast format for HD content
  • - MXF XDCAM HD422 - Commonly used Sony HD Format
  • - MXF IMX 50 - Selected by Imagen as the format to digitise SD tapes to (@50mbps)

A detailed understanding of a client's post-production workflow (with the provision of sample files, ideally) is required before confirming the availability of the option.

Storage

Storage qualifies the available digital resource to hold the media files in an Imagen system and is counted in TeraBytes (TB). The physical infrastructure of this storage will be provided by our Cloud Provider (Microsoft Azure) in a Datacentre chosen to suit the clients' needs.

Microsoft Azure assure triple local redundancy to secure data from technical failures. This means that at any given time data is stored in triple. If any copy is corrupted, it will be replaced with a replication from the redundancy.

To calculate required storage needed based on hours & quality, you can use storage this calculator tool which includes the storage needed for proxies and other renditions.

Tape Digitisation

Tape digitisation covers the process of migrating tapes from physical formats to digital files. These may come from different physical tape formats, such as Betacam, LTO Tapes, XDCam HD, VHS, 35mm Film Reels, etc.

Imagen offers digitisation services for smaller tape libraries and can suggest partners who offer large-scale digitisation projects.