Category: Tech Insight

Improve email delivery: The importance of SPF

Filed Under: Tech Insight, Tips and Tricks by midas — Leave a comment
July 11, 2019

In this blog post, we’ll take a look at SPF and why its important in ensuring email from your MIDAS room booking system is reliably delivered.

SPF stands for “Sender Policy Framework” and its purpose is to prevent unauthorized people from forging your e-mail address and pretending to be you. SPF has been around for a number of years now, but in recent times has been growing in popularity as more and more websites and email providers start enforcing it.

As our MIDAS web based room booking systems are capable of sending email on your behalf, it’s important to understand how SPF works and how it can help solve email delivery issues in MIDAS.

Take for instance the following example Scenario:

  • Your MIDAS system is running on domain “A” (i.e. your-organization.mid.as)
  • Your MIDAS system is configured to send emails to appear as though they are sent from an email address belonging to domain “B” (i.e. your-organization.com)
  • An email is sent from your MIDAS system to a recipient with an email address on domain C

In the above example, the receiving mail server for domain C queries the SPF record on domain B to check whether domain A is authorized to send mail on behalf of domain B. If it isn’t the email is rejected.

An SPF record is simply a TXT record in a given domain’s DNS, and a simple example may look similar to this:

v=spf1 +a +mx ~all

The format of an SPF record begins with a version number; the current SPF version is “v = spf1”.
Following the version string, any number of expressions may be included which are evaluated in the order they appear. These consist of an optional “qualifier” (+, -, ~, or ?) and a “mechanism” (all, a, mx, ip4, or include). The first mechanism that is matched in the SPF record determines the result of the entire valuation of the SPF record.

Qualifiers:

QualifierResultDescription
+PassDefines an authorized sender
(If no qualifier is specified, + is assumed)
–FailDefines an unauthorized sender
~SoftFailDefines an unauthorized sender
(however it may not notify the sender that their email failed)
?NeutralDefines a sender whose legitimacy isn’t determined
(In such instances, sending is allowed)

Mechanisms:

MechanismApplies if…
allalways
aAn A (or AAAA) record of the polled (or explicitly specified) domain contains the IP address of the sender
mxAn A (or AAAA) record of the polled (or explicitly specified) domain contains the IP address of the sender
ip4The specified IPv4 address is the IP address of the sender or of the specified IPv4 subnet which contains it
includeAn additional SPF request for the domain specified in the include statement contains the IP address of the sender

SPF records cannot be over 255 characters in length and cannot include more than ten “include” statements.

Example SPF record:

v=spf1 +a +ip4:1.2.3.4 -ip4:5.6.7.8 +include:somedomain.com ~all

In the above example:

  1. Email delivery will be allowed if it originated from the same domain it was sent (+a).
  2. Email delivery will also be allowed if it originated from the specific IP address 1.2.3.4
  3. Email delivery will be rejected if it originated from the IP address 5.6.7.8.
  4. Email delivery will be allowed if it matches the rules defined in the SPF record on “somedomain.com”
  5. All other email sources will be softly rejected (~all)

Bringing it back to MIDAS…

If you run a cloud-hosted MIDAS system at the domain “your-organization.mid.as”, your organization’s own website is “your-organization.com”, and you wish to allow your MIDAS system to send email on behalf of addresses @your-organization.com, then you should setup/modify an SPF record on your-organization.com.

This SPF record would authorize your hosted MIDAS system to send email on behalf of your organization. Failing to correctly set an SPF record for your domain may mean that emails sent from your MIDAS system may not reach recipients.

For our hosted customers, you can simply include “include:_spf.midas.network” in your-organization.com’s SPF record. Your new/modified SPF record may then look similar to this:

v=spf1 +a +mx include:_spf.midas.network ~all

In the above example:

  1. Email delivery will be allowed if it originated from the same domain it was sent (+a).
  2. Email delivery will be allowed if it originated from the same mail server as it was sent (+mx)
  3. Email delivery will be allowed if it matches the rules defined in the SPF record on “_spf.midas.network”. This will allow your hosted MIDAS system to become an authorized sender of email for your domain.
  4. All other email sources will be softly rejected (~all)

Remember, SPF records are simply TXT records within your domain’s DNS. If you’re not sure how to set/modify DNS records for your own domain, you’ll need to defer to the domain’s administrator, registrar, or hosting provider who should be able to assist in making the necessary adjustments to your domain’s DNS record

Further reading from our Knowledgebase:.

Tags: ,

We feel the need… the need for speed!

Filed Under: Development, Tech Insight by midas — Leave a comment
May 30, 2019

We’re committed to regularly bringing exciting new and improved features to our easy-to-use room booking system, MIDAS. We also work hard behind the scenes to constantly improve the overall speed and performance of both our software and infrastructure.

In this article, we’ll take a closer look at some of the performance improvements we’ve introduced over the past year. We’ll also look at some of the performance improvements you can look forward to in the very near future!

Caching and CDN

CDN stands for “Content Delivery Network”. It is a means whereby web content – such as an image – is stored on multiple servers around the world. When the image is requested by a visitor’s web browser, rather than the image being served from a single origin server (which may reside in another country), it is instead served by the nearest/fastest server in the CDN network. The result is significantly improved loading times for content served via a CDN.

Back in May last year (2018) we introduced CDN support for static content for all our cloud-hosted MIDAS customers.

As a result, we quickly saw performance improvements and reduction in load times of customer’s hosted MIDAS systems by up to 67%! You can read more about this in this blog post.

Improved DNS

DNS stands for “Domain Name System”, and can be considered as a “phone book” for the internet. When you enter a website in your browser’s address bar, a DNS system is used to look up the corresponding server on the internet that the URL you’ve entered resolves to, allowing you to then access the site.

This week, we’ve migrated our DNS to a distributed/cloud-based system. Previously, our DNS was provided by our own web servers. So for example, if you wanted to access our blog (blog.mid.as) the DNS system would first have to make contact with mid.as to find out the location of blog.mid.as.

With our new distributed/cloud-based DNS system, DNS is now handled in a similar way to the CDN system outlined above. That is to say that when you enter a URL/sub-domain for any part of our site, the DNS is resolved on a server geographically close to you.

As a result, we’re seeing DNS lookup times for our site up to 5 times faster than previously!

Previous MIDAS DNS response times
Previous MID.AS DNS
New MIDAS DNS response times
New MID.AS DNS

The above images (from dnsperf.com) show how quickly the mid.as domain used to resolve from various locations around the world (left image) and again now (right image).

XML vs JSON

What and what?! XML stands for eXtensible Markup Language. JSON stands for JavaScript Object Notation. Both are methods for storing and transporting data, with JSON being the newer of these two methods.

As we’ve been developing MIDAS for well over a decade now, XML has been the format we’ve used for the main settings file within our software for the majority of that time. This is because JSON wasn’t really around a decade ago!. The downside of using XML – particularly when used in conjunction with Perl (the language which MIDAS is written in) – is that it tends to be a little slow and clunky.

That’s why starting with our next software update, v4.22, we’ll be dropping the main XML settings file in favor of a JSON settings file instead. In our own benchmark testing, this simple change has resulted in improved load times of ~10ms per request. This may not sound a lot, but is actually quite noticeable.

As a result of this upcoming improvement, self-hosted customers will need to ensure that the JSON Perl module is installed and available on their MIDAS system in order to be able to update to v4.22.

Instructions of how to do this may be found in our How to install Perl modules KB article. Cloud-hosted customers don’t need to worry about this, as we’ve taken care of it!

Tags: , , , ,

MIDAS and Internet Explorer 11

Filed Under: Development, News, Tech Insight by midas — Leave a comment
October 8, 2018

Here are MIDAS HQ we love getting feedback from our customers! Whether positive or critical, all feedback is important to us. Feedback helps us to continually develop and improve our MIDAS room booking & resource scheduling software and service.

Our customer feedback is overwhelmingly positive. In fact, you can read some of these comments on our website and also on independent review sites such as TrustPilot.

However, in recent times a handful of customers have commented specifically in relation to the user interface (UI) of MIDAS, which a few perceive as now a little “dated”.

We wanted to begin addressing this for our next MIDAS update. For v4.20 we’ve introduced a number of changes and improvements in this area. You can read about these changes in this blog post.

However, we also thought it would be useful to explain some of the challenges we’ve faced with regards to the UI over the years.

As you may or may not know, MIDAS has been in continuous active development for well over a decade. Our philosophy has always been to support ALL popular web browsers. That includes Internet Explorer, Mozilla Firefox, Google Chrome, Opera, Apple Safari, and more recently Microsoft Edge.

Room Booking System for Chrome, Firefox, Safari, Opera, and EdgeSupporting all these browsers has been an enormous task over the years. But we feel strongly that our users should have a choice of which web browser they use, with a consistent MIDAS experience between browsers. Users should not be forced to use one particular browser in order to be able to access and use our MIDAS software.

It’s fair to say that the most difficult web browser to maintain support for over the years continues to be Microsoft’s Internet Explorer series. The challenge primarily has been because it has always lagged way behind all other vendor’s browser offerings in terms of its development, updates, and support for the latest standards. Essentially, the web has developed and evolved significantly over the years we’ve been developing MIDAS, yet Internet Explorer doesn’t keep up.

To some extent we’ve been “held back” over the years by our decision to continue to support customers who force their uses to use Internet Explorer. However, as of today the only version of Internet Explorer we officially support is 11. We’ve already deprecated support for IE10 & 9, IE8, IE7, and IE6 over the past decade.

MIDAS and Internet Explorer 11Continuing to support MIDAS in IE11 for the very small (and ever decreasing) percentage of our users who continue to use this old browser, limits how we can develop MIDAS, particularly in terms of the user interface.

Whilst we would have loved to have dropped IE11 support long ago, Microsoft have committed to providing mainstream support for IE11 until the end of life of the operating systems upon which it is installed. This includes Windows 7, 8 and 10. Windows 7 & 8 have both now reached their EOL (End Of Life) for mainstream support. Windows 10 however is still actively supported by Microsoft and will continue to be for the foreseeable future (for a minimum of at least two years).

That’s why we’ve taken the difficult – but necessary – decision that at some point during 2019 we’ll officially be dropping IE11 support in MIDAS.

This won’t necessarily mean that MIDAS will suddenly cease to function for IE11 users next year. But it does mean that over time new features and new user interface elements and enhancements may not display or – even function correctly – if you continue to access MIDAS using Internet Explorer 11.

If you’re currently an IE11 user, there is however, plenty of time to switch to a different web browser. There’s also plenty of choice when it comes to modern alternative web browsers.

MIDAS will continue to be supported in recent versions of Firefox, Chrome, Safari, Edge, and Opera.

We appreciate that this may affect a very small number of users. However, we hope this post gives some insight and understanding as to why we’re making this decision. We’re also confident that this will give you plenty of time to switch to an alternative, more modern, web browser.

If you have any questions or concerns over how this may impact you and your organization’s use of MIDAS, please don’t hesitate to contact us. Our friendly team will be only too happy to help!

Tags: ,

New Content Delivery Network (CDN)

Filed Under: News, Tech Insight by midas — Leave a comment
May 31, 2018

May’s been a busy month here at MIDAS HQ!

Not only have we migrated Certificate Authorities, we’ve also been testing a new Content Delivery Network (CDN) feature in MIDAS.

What does a CDN do?

To explain what a CDN does, imagine viewing a photograph online. That image will be stored on a web server somewhere. Say you’re in the UK and the server where the image resides is located in Australia. It will take your browser longer to establish a connection and retrieve the image from the other side of the world than if the server was located in the same country as you. Now, we may only be talking of a few fractions of a second longer, but if you’re viewing a web page containing several photographs, that can soon add up!

A Content Delivery Network vastly improves performance. It achieves this by storing (or “caching”) a copy of the original photograph on multiple servers all around the world. Then, when a viewer requests the photograph, the CDN serves a cached copy from whichever server is geographically closest to the viewer. This greatly improves the load time for the viewer. It also reduces the load on the original server, as the photograph is served from the CDN “cache” instead.

As a CDN “caches” a source file/web page, it is only suitable for “static” content which doesn’t change frequently, for example, images, JavaScript, Cascading Style Sheets, downloads, etc). “Dynamic” content – content which changes frequently/upon each visit – must still be served directly from the origin server, rather than via the CDN.

CDN Support in MIDAS

In MIDAS v4.18 we unofficially introduced support for serving static resources from a CDN (Cloudflare). This has been automatically enabled for all MIDAS trials and for all new cloud-hosted customers since the start of April. Since then, we’ve been closely monitoring its impact and effectiveness.

Cloudflare Content Delivery Network (CDN)
Cloudflare Content Delivery Network (CDN)

As our CDN trials proved effective and exceeded our expectations, throughout May we’ve been engaged in a phased roll-out of the CDN for remaining cloud-hosted customers. We’re pleased to announce that all cloud-hosted MIDAS systems now have CDN support enabled.

We’re currently seeing nearly 90% of all requests for static resources being served directly from Cloudflare’s global CDN network. This has led to performance improvements and reduction in load times of customer’s hosted MIDAS systems of between 13% – 67%!

We’re sure you’ll appreciate these performance improvements. They’re part of our ongoing commitment to provide the best possible service for our customers! …and we’ve more improvements and enhancements in the pipeline too!

Tags: ,